-- Logs begin at Tue 2022-08-30 01:16:55 UTC, end at Tue 2022-08-30 02:16:48 UTC. -- Aug 30 01:47:12.696541 dv-cinder-819668-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 01:47:12.705352 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 01:47:12 2022] *** Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: nodename: dv-cinder-819668-6-iscsi Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: machine: x86_64 Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: clock source: unix Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: pcre jit disabled Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: detected number of CPU cores: 4 Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: current working directory: / Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: detected binary path: /usr/bin/uwsgi-core Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: your processes number limit is 47680 Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: your memory page size is 4096 bytes Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: detected max file descriptor number: 2048 Aug 30 01:47:12.707477 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: lock engine: pthread robust mutexes Aug 30 01:47:12.708375 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: thunder lock: enabled Aug 30 01:47:12.708375 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 01:47:12.708375 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 01:47:12.746511 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: Python main interpreter initialized at 0x55caf5c399c0 Aug 30 01:47:12.746511 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: python threads support enabled Aug 30 01:47:12.746511 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: your server socket listen backlog is limited to 100 connections Aug 30 01:47:12.746511 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: your mercy for graceful operations on workers is 90 seconds Aug 30 01:47:12.746871 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 01:47:12.746952 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: *** Operational MODE: preforking *** Aug 30 01:47:12.747173 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: *** uWSGI is running in multiple interpreter mode *** Aug 30 01:47:12.747173 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: spawned uWSGI master process (pid: 105392) Aug 30 01:47:12.747392 dv-cinder-819668-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 01:47:12.748222 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: spawned uWSGI worker 1 (pid: 105393, cores: 1) Aug 30 01:47:12.748364 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: spawned uWSGI worker 2 (pid: 105394, cores: 1) Aug 30 01:47:12.748364 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 01:47:13.398911 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:47:13.399489 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:47:14.476455 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:47:14.476455 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: from cryptography.utils import int_from_bytes Aug 30 01:47:14.477135 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:47:14.477135 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: from cryptography.utils import int_from_bytes Aug 30 01:47:14.478274 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:47:14.478274 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: from cryptography.utils import int_from_bytes Aug 30 01:47:14.478684 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:47:14.478684 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: from cryptography.utils import int_from_bytes Aug 30 01:47:16.975664 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:47:16.976294 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:47:16.976457 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:47:16.976820 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:47:16.977078 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:47:16.977422 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:47:16.977784 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.977877 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:47:16.977964 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.978090 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.978202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:47:16.978410 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.978570 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:47:16.978741 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.978842 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:47:16.979057 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.979207 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.979378 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.979535 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.979700 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.979862 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.980028 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.980190 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.980309 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.980531 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.980629 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.980847 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.980947 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819668-6-iscsi {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.981174 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.981259 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.981501 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.981591 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.981832 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.981926 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.982097 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.982190 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.982417 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.982507 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.982745 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819668-6-iscsi {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.982887 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.983059 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.983183 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.983368 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.983558 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.984842 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.984842 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.985096 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.985230 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.985355 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.985355 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.985590 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.985590 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.985815 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.985815 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.986042 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.986176 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.986298 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.986425 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.986547 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.986667 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.986793 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.986932 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.987059 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.987181 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.987310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.987433 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819668-6-iscsi {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.987553 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.987673 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.987794 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.987921 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.988032 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.988159 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.988296 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.988755 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.988907 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.989070 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.989203 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819668-6-iscsi {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.989381 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.989516 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.989703 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.989870 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.990026 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.990151 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.990337 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.990464 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.990664 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.990797 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.990984 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.991116 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.991301 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.991439 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.991620 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.991749 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.991922 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.992048 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.992231 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.992405 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.992563 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.992735 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.992883 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.993008 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.993190 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.993317 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.993498 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.993623 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.993744 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.993864 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.994043 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.994170 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.994365 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.994490 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.994685 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.994810 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.995006 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.995151 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.995275 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.995404 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.995533 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.995673 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.995802 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.995924 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.996105 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.996233 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.996444 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.996582 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.996755 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.996879 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.997015 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.997139 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.997318 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.997445 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.997645 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.997784 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.997947 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.998071 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.998253 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.998387 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.998567 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.998700 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.998880 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.999008 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.999190 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.999288 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.999501 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.999598 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.999806 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:16.999907 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.000114 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.000207 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.000462 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.000550 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.000777 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.000881 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.001088 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.001183 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.001425 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.001511 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.001753 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.001859 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.002059 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.002146 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.002379 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.002465 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.002699 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.002809 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.003011 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.003117 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.003316 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.003409 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.003621 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.003711 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.003942 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.004030 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.004285 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.004385 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.004600 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.004687 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.004853 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.004939 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.005159 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.005245 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.005466 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.005554 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.005784 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.005883 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.006091 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.006177 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.006381 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.006522 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.006687 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.006813 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.006987 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.007119 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.007296 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.007422 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.007605 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.007739 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.007909 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.008044 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.008216 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.008392 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.008543 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.008681 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.008870 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.009012 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.009153 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.009274 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.009434 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.009560 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.009741 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.009881 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.010049 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.010172 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.010357 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.010482 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.010663 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.010796 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.010968 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.011093 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.011271 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.011402 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.011578 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.011711 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.011898 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.012023 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.012203 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.012344 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.012537 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.012673 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.012850 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.012956 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.013158 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.013286 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.013465 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.013599 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.013773 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.013905 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.014080 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.014204 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.014388 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.014530 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.014694 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.014817 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.014995 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.015120 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.015302 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.015428 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.015616 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.015747 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.015921 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.016051 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.016233 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.016390 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.016556 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.016680 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.016859 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.017609 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.017749 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.017871 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.017999 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.018128 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.018281 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.018407 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.018586 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.018720 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.018891 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.018995 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.019224 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.019332 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.019517 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.019620 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.019822 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.019923 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.020127 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.020220 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.020454 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.020541 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.020775 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.020862 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.021099 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.021198 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.021411 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.021511 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.021721 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.021807 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.022028 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.022127 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.022351 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:47:17.022439 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.022690 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.022787 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.023017 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.023111 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.023336 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.023434 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.023653 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.023741 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.023986 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.024082 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.024324 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.024416 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.024641 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.024727 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.024958 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.025045 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.025278 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.025363 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.025599 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.025693 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.025919 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.026005 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.026236 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.026324 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.026555 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.026709 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.026875 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.026962 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.027189 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.027274 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.027511 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.027677 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.027831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.027924 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.028153 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.028275 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.028493 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.028597 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.028808 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.028895 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.029132 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.029220 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.029467 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.029568 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.029793 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.029879 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.030108 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.030194 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.030422 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.030516 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.030738 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.030825 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.031051 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.031143 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.031378 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.031473 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.031713 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.031800 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.032030 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.032115 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.032368 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.032458 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.033253 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.033372 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.033591 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.033690 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.033908 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.033998 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.034226 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.034321 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.034546 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.034633 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.034864 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.034952 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.035180 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.035274 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.035506 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.035592 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.035822 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.035909 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.036141 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.036227 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.036488 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.036591 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.036802 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.036888 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.037124 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.037224 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.037442 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.037538 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.037758 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.037845 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.038073 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.038160 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.038383 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.038479 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.038693 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.038779 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.039002 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.039089 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.039316 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.039424 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.039624 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.039722 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.039932 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.040018 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.040261 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.040354 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.040577 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.040664 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.040893 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.040991 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.041205 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.041294 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.041517 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.041603 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.041832 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.041919 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.042144 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.042239 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.042454 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.042541 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.042768 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.042861 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.043081 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.043167 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.043388 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.043473 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.043702 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.043808 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.044012 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.044100 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.044341 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.044444 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.044656 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.044752 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.044967 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.045061 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.045275 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.045360 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.045594 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.045689 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.045904 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.045989 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.046221 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.046305 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.046534 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.046635 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.046846 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.046938 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.047164 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.047252 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.047479 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.047576 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.047793 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.047886 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.048110 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.048195 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.048479 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.048569 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.048794 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.048880 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.049116 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.049208 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.049435 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.049526 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.049753 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.049840 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.050060 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.050148 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.050374 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.050462 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.050682 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.050771 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.050990 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.051085 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.051298 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.051385 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.051619 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.051716 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.051934 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.052029 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.052250 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.052349 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.052572 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.052657 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.052877 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.052973 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.053186 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.053274 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.053493 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.053581 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.053808 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.053917 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.054112 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.054206 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.054418 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.054503 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.054724 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.054811 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.055051 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.055136 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.055366 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.055452 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.055686 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.055806 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.055998 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.056091 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.056333 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.056439 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.056683 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.056783 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.056999 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.057089 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.057319 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.057420 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.057639 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.057743 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.057956 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.058050 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.058272 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.058368 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.058589 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.058676 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.058910 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.059003 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.059224 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.059318 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.059540 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.059627 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.059852 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.059948 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.060169 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.060281 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.060519 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.060618 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.060837 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.060933 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.061148 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.061243 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.061468 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.061554 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.061798 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.061885 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.062114 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.062214 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.062440 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.062526 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.062749 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.062833 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.063067 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.063154 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.063388 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.063481 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.063702 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.063819 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.064044 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.064152 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.064380 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.064473 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.064700 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.064798 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.065025 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.065112 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.065338 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.065432 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.065661 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.065747 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.065971 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.066057 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.066287 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.066374 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.066603 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.066696 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.066918 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.067021 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.067224 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.067317 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.067542 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.067646 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.067869 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.067954 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.068186 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.068285 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.068534 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.068635 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.068850 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.068936 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.069171 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.069264 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.069484 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.069578 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.069798 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.069890 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.070113 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.070206 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.070421 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.070520 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.070729 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.070822 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.071044 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.071137 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.071357 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.071444 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.071668 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.071752 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.071978 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.072061 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.072306 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.072397 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.072623 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.072719 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.072933 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.073025 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.073244 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.073332 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.073553 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.073639 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.073860 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.073944 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.074182 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.074281 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.074490 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.074575 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.074800 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.074895 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.075114 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.075200 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.075422 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.075546 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.075746 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.075850 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.076054 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.076140 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.076428 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.076525 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.076706 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.076806 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.077012 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.077098 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.077317 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.077403 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.077646 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.077740 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.077965 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.078061 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.078273 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.078362 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.078583 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.078669 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.078895 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.078985 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.079206 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.079290 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.080051 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.080150 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.080397 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.080504 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.080714 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.080813 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.081039 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.081127 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.081355 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.081439 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.081667 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.081754 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.081980 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.082068 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.082385 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.082673 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.082673 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.082818 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.082893 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.082959 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.083219 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.083309 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.083531 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.083625 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.083847 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.083939 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.084168 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.084296 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.084489 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.084585 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.084802 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.084889 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.085119 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.085204 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.085495 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.085691 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.085813 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.086027 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.086113 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.086348 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.086451 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.086677 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.086764 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.087002 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.087291 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.087385 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.087630 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.087733 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.087955 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.088042 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.088304 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.088412 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.088632 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.088745 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.088948 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.089048 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.089259 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.089355 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.089568 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.089655 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.089882 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.089970 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.090192 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.090278 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.090501 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.090594 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.090809 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.090898 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.091121 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.091207 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.091429 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.091515 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.091738 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.091824 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.092043 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.092136 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.092374 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.092463 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.092692 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.092789 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.093001 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.093092 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.093313 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.093408 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.093617 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.093704 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.093925 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.094018 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.094241 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.094337 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.094549 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.094636 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.094855 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.094942 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.095699 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.095802 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.096045 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.096132 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.096380 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.096472 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.096692 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.096790 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.097004 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.097099 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.097316 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.097398 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.097666 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.097754 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.097973 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.098058 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.098300 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.098385 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.098608 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.098695 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.098916 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.099002 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.099223 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.099310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.099536 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.099624 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.099844 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.099929 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.100150 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.100233 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.100490 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.100585 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.100800 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.100892 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.101110 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.101204 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.101423 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.101509 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.101727 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.101811 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.102039 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.102138 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.102349 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.102442 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.102660 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.102745 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.102973 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.103072 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.103279 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.103364 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.103582 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.103668 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.103889 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.103982 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.104199 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.104301 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.104529 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.104616 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.104838 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.104925 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.105140 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.105225 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.105454 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.105540 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.105759 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.105845 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.106064 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.106151 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.106370 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.106458 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.106678 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.106765 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.106989 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.107074 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.107296 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.107389 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.107609 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.107705 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.107920 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.108007 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.108224 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.108355 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.108553 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.108648 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.108860 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.108946 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.109166 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.109260 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.109473 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.109568 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.109785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.109872 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.110094 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.110188 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.110409 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.110493 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.110733 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.110856 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.111145 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.111248 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.111528 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.111616 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.111874 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.111970 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.112189 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.112356 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.112529 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.112617 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.112839 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.112942 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.113149 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.113236 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.113458 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.113812 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.114029 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.114122 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.114335 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.114429 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.114646 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.114738 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.114957 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.115045 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.115262 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.115349 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.115570 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.115654 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.115873 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.115967 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.116205 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.116382 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.116556 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.116641 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.116865 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.116968 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.117177 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.117271 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.117487 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.117573 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.117832 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.117927 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.118140 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.118225 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.118452 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.118537 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.118769 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.118864 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.119078 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.119172 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.119395 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.119481 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.119709 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.119804 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.120023 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.120109 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.120352 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.120482 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.120662 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.120751 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.120983 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.121069 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.121292 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.121377 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.121607 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.121695 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.121915 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.122009 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.122226 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.122313 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.122552 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.122640 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.122857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.122955 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.123168 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.123255 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.123481 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.123570 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.123791 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.123877 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.124103 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.124200 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.124441 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.124529 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.124754 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.124840 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.125066 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.125165 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.125378 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.125463 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.125689 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.125782 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.126003 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.126098 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.126336 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.126424 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.126655 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.126742 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.126967 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.127074 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.127275 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.127362 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.127587 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.127680 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.127898 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.127989 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.128203 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.128310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.128539 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.128625 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.128846 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.128938 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.129160 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.129256 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.129467 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.129553 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.129775 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.129895 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.130089 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.130211 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.130400 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.130526 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.130717 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.130834 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.131027 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.131148 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.131457 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.131559 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.131774 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.131862 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.132091 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.132179 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.132422 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.132523 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.132757 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.132849 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.133076 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.133163 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.133399 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.133495 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.133721 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.133815 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.134030 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.134118 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.134335 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.134454 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.134648 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.134773 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.134976 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.135090 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.135283 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.135408 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.135589 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.135719 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.135895 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.136034 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.136218 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.136373 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.136549 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.136706 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.136877 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.137017 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.137295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.137384 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.137611 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.137698 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.137920 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.138008 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.138235 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.138322 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.138564 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.138652 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.138938 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.139036 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.139263 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.139348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.139588 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.139681 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.139914 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.140009 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.140223 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.140379 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.140564 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.140652 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.140879 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.140966 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.141203 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.141299 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.141531 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.141618 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.141845 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.141932 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.142692 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.142789 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.143003 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.143092 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.143330 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.143416 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.143652 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.143748 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.143967 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.144055 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.144308 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.144412 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.144623 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.144714 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.144951 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.145041 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.145279 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.145365 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.145599 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.145687 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.145930 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.146018 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.146258 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.146345 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.146567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.146656 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.146885 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.146978 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.147194 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.147294 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.147502 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.147590 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.147826 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.147913 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.148133 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.148233 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.148511 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.148598 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.148823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.148912 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.149135 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.149233 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.149440 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.149527 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.149748 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.149836 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.150068 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.150168 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.150374 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.150460 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.150687 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.150811 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.151000 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.151097 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.151311 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.151406 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.151633 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.151719 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.151943 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.152032 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.152289 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.152418 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.152606 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.152726 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.152914 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.153012 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.153220 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.153315 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.153527 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.153614 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.153858 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.153953 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.154165 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.154250 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.154476 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.154562 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.154790 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.154879 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.155101 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.155188 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.155425 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.155519 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.155748 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.155834 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.156075 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.156160 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.156423 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.156526 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.156750 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.156837 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.157075 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.157166 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.157381 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.157477 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.158245 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.158347 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.158560 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.158647 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.158868 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.158957 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.159177 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.159263 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.159483 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.159569 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.159793 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.159882 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.160100 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.160196 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.160433 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.160533 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.160741 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.160833 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.161067 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.161165 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.161375 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.161478 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.161682 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.161769 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.161994 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.162082 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.162300 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.162394 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.162608 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.162696 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.162915 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.163002 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.163241 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.163340 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.163553 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.163649 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.163861 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.163947 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.164172 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.164292 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.164503 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.164593 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.164829 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.164915 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.165148 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.165243 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.165463 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.165549 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.165783 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.165871 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.166102 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.166192 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.166422 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.166515 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.166741 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.166834 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.167053 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.167141 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.167369 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.167454 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.167684 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.167778 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.168002 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.168093 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.168349 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.168560 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.168669 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.168901 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.169001 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.169228 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.169316 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.169555 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.169649 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.169878 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.170116 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.170205 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.170453 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.170539 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.170775 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.170870 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.171097 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.171230 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.171445 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.171535 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.171765 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.171862 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.172086 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.172183 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.172430 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.172519 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.172749 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.172849 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.173067 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.173156 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.173410 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.173500 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.173731 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.173818 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.174052 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.174140 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.174374 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.174465 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.174712 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.174800 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.175034 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.175122 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.175344 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.175445 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.175663 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.175758 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.175980 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.176067 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.176320 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.176429 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.176638 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.176726 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.176956 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.177043 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.177274 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.177371 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.177592 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.177687 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.177909 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.177997 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.178223 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.178312 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.178540 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.178626 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.178854 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.178948 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.179171 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.179258 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.179489 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.179578 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.179806 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.179902 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.180121 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.180209 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.180465 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.180554 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.180785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.180884 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.181125 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.181306 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.181453 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.181624 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.181774 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.181960 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.182097 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.182290 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.182420 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.182618 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.182939 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.183032 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.183260 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.183348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.183591 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.183679 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.183906 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.183996 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.184217 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.184369 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.184567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.184664 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.184881 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.184977 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.185216 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.185303 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.185534 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.185624 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.185850 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.185947 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.186164 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.186259 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.186483 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.186581 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.186796 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.186883 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.187123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.187328 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.187445 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.187677 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.187766 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.187999 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.188086 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.188356 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.188446 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.188690 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.188956 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.189044 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.189306 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.189394 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.189632 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.189729 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.189947 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.190034 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.190257 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.190344 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.190578 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.190667 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.190894 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.190979 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.191202 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.191289 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.191511 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.191600 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.191823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.191908 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.192132 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.192216 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.192454 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.192547 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.192767 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.192855 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.193075 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.193163 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.193392 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.193479 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.193702 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.193788 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.194012 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.194108 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.194322 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.194410 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.194630 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.194720 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.194938 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.195033 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.195248 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.195336 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.195558 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.195643 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.195863 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.195958 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.196178 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.196290 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.196513 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.196600 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.196825 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.196926 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.197132 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.197218 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.197441 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.197528 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.197747 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.197836 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.198057 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.198142 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.198374 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.198461 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.198686 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.198775 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.199005 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.199091 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.199311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.199405 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.199626 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.199713 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.199936 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.200023 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.200279 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.200382 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.200600 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.200690 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.200915 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.201015 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.201238 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.201374 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.201557 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.201645 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.201887 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.202088 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.202206 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.202427 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.202523 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.202752 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.202861 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.203087 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.203174 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.203422 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.203710 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.203799 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.204035 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.204120 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.204366 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.204964 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.205220 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.205316 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.205537 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.205704 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.205887 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.205984 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.206203 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.206291 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.206519 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.206607 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.206839 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.206929 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.207151 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.207238 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.207462 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.207561 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.207776 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.207866 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.208086 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.208173 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.208424 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.208528 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.208739 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.208873 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.209053 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.209141 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.209364 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.209459 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.209675 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.209769 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.209988 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.210074 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.210304 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.210406 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.210619 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.210707 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.210934 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.211030 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.211249 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.211338 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.211566 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.211690 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.211881 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.211977 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.212216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.212330 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.212531 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.212619 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.212844 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.212931 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.213165 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.213255 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.213479 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.213574 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.213796 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.213884 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.214102 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.214190 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.214414 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.214501 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.214735 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.214838 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.215072 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.215160 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.215394 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.215482 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.215705 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.215802 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.216047 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.216134 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.216398 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.216501 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.216720 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.216818 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.217043 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.217131 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.217359 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.217446 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.217690 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.217780 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.218029 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.218122 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.218349 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.218436 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.218674 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.218768 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.218983 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.219077 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.219292 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.219380 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.219601 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.219698 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.219913 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.220000 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.220808 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.220925 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.221132 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.221221 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.221440 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.221527 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.221747 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.221865 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.222060 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.222149 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.222366 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.222455 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.222672 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.222770 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.222983 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.223113 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.223290 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.223415 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.223601 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.223740 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.223909 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.224037 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.224212 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.224398 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.224533 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.224656 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.224832 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.224968 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.225137 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.225261 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.225442 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.225570 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.225803 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.225935 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.226054 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.226176 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.226347 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.226482 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.226652 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.226812 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.226999 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.227156 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.227330 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.227468 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.227614 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.227755 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.227898 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.228148 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.228333 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.228459 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.228546 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.228626 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.228749 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.228852 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.229088 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.229176 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.229430 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.229517 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.229761 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.229933 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.230111 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.230320 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.230476 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.230620 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.230750 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.230841 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.230999 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.231098 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.231312 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.231399 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.231626 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.231715 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.231938 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.232025 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.232301 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.232394 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.232587 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.232679 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.232899 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.232987 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.233212 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.233307 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.233524 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.233613 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.233835 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.233921 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.234149 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.234245 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.234465 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.234553 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.234782 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.234871 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.235096 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.235195 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.235409 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.235498 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.235763 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.235865 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.236077 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.236180 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.236415 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.236504 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.236733 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.236820 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.237047 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.237142 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.237358 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.237453 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.237675 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.237769 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.237988 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.238077 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.238301 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.238388 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.238876 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.238975 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.239190 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.239267 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.239593 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.239738 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.239824 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.239915 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.240127 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.240216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.240477 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.240567 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.240800 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.240902 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.241133 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.241221 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.241449 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.241544 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.241769 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.241869 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.242100 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.242188 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.242414 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.242501 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.242729 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.242825 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.243034 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.243122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.243280 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:47:17.243419 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.243755 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.244078 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.244417 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.244730 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:47:17.244979 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:47:17.396794 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO dbcounter [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Registered counter for database nova_api Aug 30 01:47:17.397952 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO dbcounter [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Registered counter for database nova_api Aug 30 01:47:17.417614 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG oslo_db.sqlalchemy.engines [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:47:17.420000 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_db.sqlalchemy.engines [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:47:17.424388 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writer thread running {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:47:17.426497 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writer thread running {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:47:17.481450 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.context [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99d86a54-00a5-438e-9f83-1aa5b257911d(cell1) {{(pid=105393) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:47:17.482409 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.context [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99d86a54-00a5-438e-9f83-1aa5b257911d(cell1) {{(pid=105394) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:47:17.485272 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG oslo_concurrency.lockutils [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:47:17.485799 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG oslo_concurrency.lockutils [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:47:17.486180 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:47:17.486658 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:47:17.487384 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG oslo_concurrency.lockutils [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:47:17.488104 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG oslo_concurrency.lockutils [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:47:17.488202 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:47:17.488838 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG oslo_concurrency.lockutils [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:47:17.489167 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:47:17.489609 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:47:17.490822 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG oslo_concurrency.lockutils [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:47:17.491603 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:47:17.492798 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO dbcounter [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Registered counter for database nova_cell0 Aug 30 01:47:17.493595 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO dbcounter [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Registered counter for database nova_cell0 Aug 30 01:47:17.496768 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO dbcounter [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Registered counter for database nova_cell1 Aug 30 01:47:17.497502 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO dbcounter [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Registered counter for database nova_cell1 Aug 30 01:47:17.505007 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG oslo_db.sqlalchemy.engines [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:47:17.506721 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG oslo_db.sqlalchemy.engines [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:47:17.508123 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_db.sqlalchemy.engines [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:47:17.511587 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_db.sqlalchemy.engines [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:47:17.512805 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writer thread running {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:47:17.514026 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writer thread running {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:47:17.515051 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writer thread running {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:47:17.653786 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writer thread running {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:47:17.660937 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO dbcounter [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Registered counter for database nova_cell0 Aug 30 01:47:17.662241 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO dbcounter [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Registered counter for database nova_cell0 Aug 30 01:47:17.667713 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG oslo_db.sqlalchemy.engines [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:47:17.669565 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_db.sqlalchemy.engines [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:47:17.672584 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writer thread running {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:47:17.674757 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writer thread running {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:47:18.006653 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: WARNING keystonemiddleware.auth_token [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:47:18.009838 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: WARNING keystonemiddleware.auth_token [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:47:18.013866 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: WARNING keystonemiddleware.auth_token [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:47:18.017618 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: WARNING keystonemiddleware.auth_token [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:47:18.354544 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: WARNING keystonemiddleware.auth_token [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:47:18.359220 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: WARNING keystonemiddleware.auth_token [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:47:18.360497 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: WARNING keystonemiddleware.auth_token [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:47:18.365488 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: WARNING keystonemiddleware.auth_token [None req-bda0d0f0-c319-4ff8-baa4-02298ad132ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:47:18.365974 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caf5c399c0 pid: 105394 (default app) Aug 30 01:47:18.368031 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:47:18.369224 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001752 Aug 30 01:47:18.369647 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Tue Aug 30 01:47:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:47:18.370736 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caf5c399c0 pid: 105393 (default app) Aug 30 01:48:35.605969 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:35.607987 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002572 Aug 30 01:48:35.608621 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:48:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:48:35.624868 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writing DB stats nova_api:SELECT=3 {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:48:35.625972 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writing DB stats nova_cell0:SELECT=3 {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:48:35.626804 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writing DB stats nova_cell1:SELECT=3 {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:48:35.627804 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:48:36.478829 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-b09fb8b3-6ecf-40ca-92ad-8316f05652ed admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:36.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-b09fb8b3-6ecf-40ca-92ad-8316f05652ed admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.896810 Aug 30 01:48:36.513527 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 01:48:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:48:38.879060 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:38.880058 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-168341b0-98f3-4456-9100-4bfc89ec61bb None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 30 01:48:38.880643 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:48:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:48:39.344941 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-e2a10bbd-96a1-4313-a8cc-cf156108d182 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:39.392877 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-e2a10bbd-96a1-4313-a8cc-cf156108d182 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.506255 Aug 30 01:48:39.393522 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 01:48:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:48:39.407567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writing DB stats nova_api:SELECT=3 {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:48:39.408659 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writing DB stats nova_cell0:SELECT=3 {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:48:39.409390 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writing DB stats nova_cell1:SELECT=3 {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:48:39.410410 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:48:39.623263 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-4e3e3556-bb56-4aad-b634-7765e8b69841 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:39.686706 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-4e3e3556-bb56-4aad-b634-7765e8b69841 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284664 Aug 30 01:48:39.687708 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 30 01:48:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:48:42.031820 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-e2a10bbd-96a1-4313-a8cc-cf156108d182 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:42.032863 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-e2a10bbd-96a1-4313-a8cc-cf156108d182 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002024 Aug 30 01:48:42.033755 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:48:42.697498 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-0800b1f6-ac17-4fd9-ba1d-42b7938f2aa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "vcpus": 1, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:42.735195 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-0800b1f6-ac17-4fd9-ba1d-42b7938f2aa0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.695318 Aug 30 01:48:42.735748 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 01:48:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:48:42.748100 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-3d8ee262-8b56-4daf-9d19-34ed2fa80b57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:42.784901 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-3d8ee262-8b56-4daf-9d19-34ed2fa80b57 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040449 Aug 30 01:48:42.785521 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 30 01:48:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:48:45.173788 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-0800b1f6-ac17-4fd9-ba1d-42b7938f2aa0 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:45.174820 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-0800b1f6-ac17-4fd9-ba1d-42b7938f2aa0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Aug 30 01:48:45.175234 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:48:45.572348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-227026f0-ae6d-4102-b762-032ea4b04db5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "id": "d2", "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:45.591763 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-227026f0-ae6d-4102-b762-032ea4b04db5 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.410592 Aug 30 01:48:45.592335 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 01:48:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:48:45.604684 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-da047aee-5273-4d73-bde4-3955bf7a257a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:45.630508 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-da047aee-5273-4d73-bde4-3955bf7a257a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029376 Aug 30 01:48:45.631087 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 30 01:48:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:48:47.996323 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-227026f0-ae6d-4102-b762-032ea4b04db5 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:47.997900 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-227026f0-ae6d-4102-b762-032ea4b04db5 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Aug 30 01:48:47.998470 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:48:48.464019 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-fdd21acd-1b69-41e2-9943-9c6bf4dacf57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "id": "d3", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:48.484349 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-fdd21acd-1b69-41e2-9943-9c6bf4dacf57 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477960 Aug 30 01:48:48.485092 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 01:48:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:48:48.497155 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-0765721e-d0e2-478b-8a9d-05ad961eccab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:48.522662 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-0765721e-d0e2-478b-8a9d-05ad961eccab admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029130 Aug 30 01:48:48.523442 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 30 01:48:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:48:50.873685 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-fdd21acd-1b69-41e2-9943-9c6bf4dacf57 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:50.875124 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-fdd21acd-1b69-41e2-9943-9c6bf4dacf57 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 30 01:48:50.875523 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:48:51.314612 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-4c631eed-1361-4338-a12b-293a19110c47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:51.337182 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-4c631eed-1361-4338-a12b-293a19110c47 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455369 Aug 30 01:48:51.337858 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 01:48:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:48:51.350793 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-4295ed99-ca26-4e48-b60c-e3d503f99d24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:51.382194 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-4295ed99-ca26-4e48-b60c-e3d503f99d24 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035101 Aug 30 01:48:51.382938 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 30 01:48:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:48:53.782228 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-4c631eed-1361-4338-a12b-293a19110c47 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:53.783254 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-4c631eed-1361-4338-a12b-293a19110c47 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 30 01:48:53.783660 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:48:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:48:54.206862 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-ffab7b4f-03a9-4c20-a829-5265799bb121 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:54.230794 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-ffab7b4f-03a9-4c20-a829-5265799bb121 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.441064 Aug 30 01:48:54.231344 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 01:48:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:48:56.676691 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-4c631eed-1361-4338-a12b-293a19110c47 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:56.677699 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-4c631eed-1361-4338-a12b-293a19110c47 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 30 01:48:56.678106 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:48:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:48:57.109876 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-e56dd0b7-ccfe-4355-b7de-cbeea3ba9bf1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:57.130261 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-e56dd0b7-ccfe-4355-b7de-cbeea3ba9bf1 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.444729 Aug 30 01:48:57.131005 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 01:48:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:48:57.145051 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-ea397eb7-b7bc-4cd7-bf94-77f2fbe69bfc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:57.169380 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-ea397eb7-b7bc-4cd7-bf94-77f2fbe69bfc admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028052 Aug 30 01:48:57.169952 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 30 01:48:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:48:59.496272 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-e56dd0b7-ccfe-4355-b7de-cbeea3ba9bf1 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:48:59.497311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-e56dd0b7-ccfe-4355-b7de-cbeea3ba9bf1 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 30 01:48:59.497716 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:48:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:48:59.910293 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-c076223e-837f-4089-b580-9b88d46c562e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:59.928554 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-c076223e-837f-4089-b580-9b88d46c562e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424229 Aug 30 01:48:59.929110 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 01:48:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:48:59.941871 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-7876b80d-1f23-484a-b98d-dc604c11237d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:48:59.965595 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-7876b80d-1f23-484a-b98d-dc604c11237d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027423 Aug 30 01:48:59.966157 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 30 01:48:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:49:02.316159 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-c076223e-837f-4089-b580-9b88d46c562e admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:02.317162 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-c076223e-837f-4089-b580-9b88d46c562e admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 30 01:49:02.320565 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:49:02 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:02.722157 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-0eaa7012-3b32-4cf8-98af-c0d04798233e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "disk": 40}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:49:02.743768 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-0eaa7012-3b32-4cf8-98af-c0d04798233e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.419400 Aug 30 01:49:02.744564 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 01:49:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:49:02.757213 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-be75b389-26cb-40be-b6dd-307911381fda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:49:02.781982 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-be75b389-26cb-40be-b6dd-307911381fda admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028901 Aug 30 01:49:02.782775 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 30 01:49:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:49:05.127540 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-0eaa7012-3b32-4cf8-98af-c0d04798233e admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:05.128594 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-0eaa7012-3b32-4cf8-98af-c0d04798233e admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 30 01:49:05.129164 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:49:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:05.638333 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-ab016e2e-be38-44f4-9850-73f4c449ccc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "disk": 80, "id": "4", "name": "m1.large", "vcpus": 4}} {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:49:05.658333 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-ab016e2e-be38-44f4-9850-73f4c449ccc4 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.522982 Aug 30 01:49:05.658975 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 01:49:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:49:05.672557 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-dbe79618-8428-417a-8eb5-cd019fcf3b96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:49:05.704108 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-dbe79618-8428-417a-8eb5-cd019fcf3b96 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036104 Aug 30 01:49:05.705351 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 30 01:49:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:49:08.093475 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-ab016e2e-be38-44f4-9850-73f4c449ccc4 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:08.094793 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-ab016e2e-be38-44f4-9850-73f4c449ccc4 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002316 Aug 30 01:49:08.095571 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:49:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:08.520965 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-d80b40d0-4b49-4b52-9f82-82f198cb674c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:49:08.540586 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-d80b40d0-4b49-4b52-9f82-82f198cb674c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.438340 Aug 30 01:49:08.544555 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 30 01:49:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:49:08.552664 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-61c989e2-983b-4581-b7cb-26f32cbe4d4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:49:08.558639 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:49:08.581476 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-61c989e2-983b-4581-b7cb-26f32cbe4d4e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032381 Aug 30 01:49:08.582640 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 30 01:49:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:49:27.272972 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-d80b40d0-4b49-4b52-9f82-82f198cb674c admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:27.273897 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-d80b40d0-4b49-4b52-9f82-82f198cb674c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 30 01:49:27.274297 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:49:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:27.285417 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:49:27.658743 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-5da809f1-addf-43a4-8fad-b0797b3478b3 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:27.677608 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-5da809f1-addf-43a4-8fad-b0797b3478b3 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396627 Aug 30 01:49:27.678132 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 01:49:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:49:28.721321 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-d80b40d0-4b49-4b52-9f82-82f198cb674c admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:28.722349 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-d80b40d0-4b49-4b52-9f82-82f198cb674c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 30 01:49:28.722741 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:49:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:29.238038 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-b820ea5a-8b00-4693-87d0-67071ac80fa4 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:29.243864 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.wsgi [None req-b820ea5a-8b00-4693-87d0-67071ac80fa4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-b820ea5a-8b00-4693-87d0-67071ac80fa4 admin admin] Request method failure captured: Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Accept: application/json Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Accept-Encoding: gzip, deflate Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Connection: keep-alive Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Content-Length: 0 Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Host: 10.222.0.50 Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Openstack-Api-Version: compute 2.90 Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Openstack-System-Scope: None Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: User-Agent: python-novaclient Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Auth-Token: gAAAAABjDWyo7Hs9t5LLfEaZbQJsfCr9ptYgOkxyg4Jq_X0fgsURQjEPLszTcu3c98660jCRSOibwdUEg7vMIiGUnJaxHJ6J-AFw0TtWhq-HAkOu4q_jyEW2tVE99xB2LFQH0HJNICdIyQgWyxGlxyp0xI9Xsy1XcMWP6eVz4I9SfqP1QUvEzLc Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Domain-Id: None Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Domain-Name: None Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Identity-Status: Confirmed Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Is-Admin-Project: True Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Domain-Id: default Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Domain-Name: Default Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Name: admin Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Role: member,reader,admin Aug 30 01:49:29.247109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Roles: member,reader,admin Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e7c73461b5344be681351a70b1beafa9"}]}] Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Tenant: admin Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Tenant-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Tenant-Name: admin Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User: admin Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Domain-Id: default Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Domain-Name: Default Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Id: a8eb78c86bca426c9163deb9994b5cec Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Name: admin Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: method: > Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: exception: Flavor 42 could not be found. Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: action_args: {'id': '42'} Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:49:29.249326 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:29.252976 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:29.254341 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-b820ea5a-8b00-4693-87d0-67071ac80fa4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:49:29.255564 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-b820ea5a-8b00-4693-87d0-67071ac80fa4 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387529 Aug 30 01:49:29.255564 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 01:49:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:49:29.258937 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-08b5dd96-6bd7-4803-8dfb-bcca05acd7ff admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:29.263304 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:49:29.284016 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-08b5dd96-6bd7-4803-8dfb-bcca05acd7ff admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028568 Aug 30 01:49:29.284588 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 01:49:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:49:29.294495 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-ad22cc88-c126-47b4-b072-e9bebf539e42 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:29.317601 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-ad22cc88-c126-47b4-b072-e9bebf539e42 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026697 Aug 30 01:49:29.318143 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 01:49:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:49:29.328422 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-760c1f82-3855-4421-b0b5-6125f2f6de9a admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:29.334881 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.wsgi [None req-760c1f82-3855-4421-b0b5-6125f2f6de9a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-760c1f82-3855-4421-b0b5-6125f2f6de9a admin admin] Request method failure captured: Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Accept: application/json Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Accept-Encoding: gzip, deflate Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Connection: keep-alive Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Content-Length: 0 Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Host: 10.222.0.50 Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Openstack-Api-Version: compute 2.90 Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Openstack-System-Scope: None Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: User-Agent: python-novaclient Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Auth-Token: gAAAAABjDWyo7Hs9t5LLfEaZbQJsfCr9ptYgOkxyg4Jq_X0fgsURQjEPLszTcu3c98660jCRSOibwdUEg7vMIiGUnJaxHJ6J-AFw0TtWhq-HAkOu4q_jyEW2tVE99xB2LFQH0HJNICdIyQgWyxGlxyp0xI9Xsy1XcMWP6eVz4I9SfqP1QUvEzLc Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Domain-Id: None Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Domain-Name: None Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Identity-Status: Confirmed Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Is-Admin-Project: True Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Domain-Id: default Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Domain-Name: Default Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Name: admin Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Role: member,reader,admin Aug 30 01:49:29.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Roles: member,reader,admin Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e7c73461b5344be681351a70b1beafa9"}]}] Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Tenant: admin Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Tenant-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Tenant-Name: admin Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User: admin Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Domain-Id: default Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Domain-Name: Default Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Id: a8eb78c86bca426c9163deb9994b5cec Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Name: admin Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: method: > Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: exception: Flavor 42 could not be found. Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: action_args: {'id': '42'} Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:49:29.339583 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:29.340552 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:29.341857 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-760c1f82-3855-4421-b0b5-6125f2f6de9a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:49:29.343106 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-760c1f82-3855-4421-b0b5-6125f2f6de9a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015491 Aug 30 01:49:29.343106 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 01:49:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:49:30.302007 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-ad22cc88-c126-47b4-b072-e9bebf539e42 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:30.303037 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-ad22cc88-c126-47b4-b072-e9bebf539e42 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 30 01:49:30.303445 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:49:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:30.813041 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-c102723b-e947-41aa-8951-0f990cdd1784 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:30.818788 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.wsgi [None req-c102723b-e947-41aa-8951-0f990cdd1784 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-c102723b-e947-41aa-8951-0f990cdd1784 admin admin] Request method failure captured: Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Accept: application/json Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Accept-Encoding: gzip, deflate Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Connection: keep-alive Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Content-Length: 0 Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Host: 10.222.0.50 Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Openstack-Api-Version: compute 2.90 Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Openstack-System-Scope: None Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: User-Agent: python-novaclient Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Auth-Token: gAAAAABjDWyqpCi5376YjuSt538S6Ttf88lKVo62hQTypKxdf6yWRqU76MPTuzzoNebIHqu8YBqA4FKVtomaaJdYybpzTEoLgGhAGYb663uC741QvZWwWFKRgUHxtchW7uANsVmmnBIDgGdodCjv3vF3h1P1HTx7Y-xv3EhdpzfpJztdtfUjgs0 Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Domain-Id: None Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Domain-Name: None Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Identity-Status: Confirmed Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Is-Admin-Project: True Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Domain-Id: default Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Domain-Name: Default Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Name: admin Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Role: member,reader,admin Aug 30 01:49:30.820295 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Roles: member,reader,admin Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e7c73461b5344be681351a70b1beafa9"}]}] Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Tenant: admin Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Tenant-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Tenant-Name: admin Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User: admin Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Domain-Id: default Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Domain-Name: Default Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Id: a8eb78c86bca426c9163deb9994b5cec Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Name: admin Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: method: > Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: exception: Flavor 84 could not be found. Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: action_args: {'id': '84'} Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:49:30.821818 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:30.822661 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:30.823785 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-c102723b-e947-41aa-8951-0f990cdd1784 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:49:30.825035 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-c102723b-e947-41aa-8951-0f990cdd1784 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.379030 Aug 30 01:49:30.825035 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 01:49:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 380 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:49:30.831943 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-6e3d1b33-f9ee-4096-9254-da12eb6e6c15 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:30.847323 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-6e3d1b33-f9ee-4096-9254-da12eb6e6c15 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018939 Aug 30 01:49:30.847843 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 01:49:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:49:30.857131 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-7d350fba-675e-44d5-9476-42a919092e23 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:30.871987 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-7d350fba-675e-44d5-9476-42a919092e23 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018384 Aug 30 01:49:30.872545 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 01:49:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:49:30.881416 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-79a70ef0-26f9-490f-b7f2-eee16302b27a admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:30.886616 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.wsgi [None req-79a70ef0-26f9-490f-b7f2-eee16302b27a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-79a70ef0-26f9-490f-b7f2-eee16302b27a admin admin] Request method failure captured: Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Accept: application/json Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Accept-Encoding: gzip, deflate Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Connection: keep-alive Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Content-Length: 0 Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Host: 10.222.0.50 Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Openstack-Api-Version: compute 2.90 Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Openstack-System-Scope: None Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: User-Agent: python-novaclient Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Auth-Token: gAAAAABjDWyqpCi5376YjuSt538S6Ttf88lKVo62hQTypKxdf6yWRqU76MPTuzzoNebIHqu8YBqA4FKVtomaaJdYybpzTEoLgGhAGYb663uC741QvZWwWFKRgUHxtchW7uANsVmmnBIDgGdodCjv3vF3h1P1HTx7Y-xv3EhdpzfpJztdtfUjgs0 Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Domain-Id: None Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Domain-Name: None Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Identity-Status: Confirmed Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Is-Admin-Project: True Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Domain-Id: default Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Domain-Name: Default Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Name: admin Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Role: member,reader,admin Aug 30 01:49:30.888123 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Roles: member,reader,admin Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e7c73461b5344be681351a70b1beafa9"}]}] Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Tenant: admin Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Tenant-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Tenant-Name: admin Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User: admin Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Domain-Id: default Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Domain-Name: Default Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Id: a8eb78c86bca426c9163deb9994b5cec Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Name: admin Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: method: > Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: exception: Flavor 84 could not be found. Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: action_args: {'id': '84'} Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:49:30.890310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:30.891348 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:30.892823 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-79a70ef0-26f9-490f-b7f2-eee16302b27a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:49:30.894057 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-79a70ef0-26f9-490f-b7f2-eee16302b27a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011479 Aug 30 01:49:30.894057 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 30 01:49:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:49:31.854005 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-7d350fba-675e-44d5-9476-42a919092e23 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:31.855010 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-7d350fba-675e-44d5-9476-42a919092e23 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 30 01:49:31.855404 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:49:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:32.377054 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-5009b363-5e24-40c4-8602-8e3a47c04e06 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:32.382708 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.wsgi [None req-5009b363-5e24-40c4-8602-8e3a47c04e06 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-5009b363-5e24-40c4-8602-8e3a47c04e06 admin admin] Request method failure captured: Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Accept: application/json Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Accept-Encoding: gzip, deflate Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Connection: keep-alive Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Content-Length: 0 Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Host: 10.222.0.50 Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Openstack-Api-Version: compute 2.90 Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Openstack-System-Scope: None Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: User-Agent: python-novaclient Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Auth-Token: gAAAAABjDWyrCwZ7clcCLFUVCQ9TXtxMn2mI2uJ6IcKP-9iYzIweKMzzgI5do49A0LFF1sFr89x90vMm0BAaDcdF_amLJmUV84s0-6r-rLjh1iZg1gLe_yAIcsWUanqWbV4v_2ifu81FGGsgKHrL9xWTqCaRN-Fc6mkMcbY5ljnnGLHFDcuuK8s Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Domain-Id: None Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Domain-Name: None Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Identity-Status: Confirmed Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Is-Admin-Project: True Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Domain-Id: default Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Domain-Name: Default Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Project-Name: admin Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Role: member,reader,admin Aug 30 01:49:32.384202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Roles: member,reader,admin Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e7c73461b5344be681351a70b1beafa9"}]}] Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Tenant: admin Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Tenant-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-Tenant-Name: admin Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User: admin Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Domain-Id: default Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Domain-Name: Default Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Id: a8eb78c86bca426c9163deb9994b5cec Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: X-User-Name: admin Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: method: > Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: exception: Flavor 451 could not be found. Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: action_args: {'id': '451'} Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:49:32.385831 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:32.386826 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: ERROR nova.api.openstack.wsgi Aug 30 01:49:32.388122 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-5009b363-5e24-40c4-8602-8e3a47c04e06 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:49:32.389438 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-5009b363-5e24-40c4-8602-8e3a47c04e06 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392399 Aug 30 01:49:32.389438 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 01:49:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:49:32.395383 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-75736c20-2525-4bb9-be9f-5c42719cbf36 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:32.410064 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-75736c20-2525-4bb9-be9f-5c42719cbf36 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018228 Aug 30 01:49:32.410595 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 01:49:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:49:32.419983 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:32.435566 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019068 Aug 30 01:49:32.436745 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 30 01:49:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:49:32.445812 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-79b443fd-40b7-45f0-b41d-512fe2375023 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:32.451302 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.wsgi [None req-79b443fd-40b7-45f0-b41d-512fe2375023 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-79b443fd-40b7-45f0-b41d-512fe2375023 admin admin] Request method failure captured: Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Accept: application/json Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Accept-Encoding: gzip, deflate Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Connection: keep-alive Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Content-Length: 0 Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Host: 10.222.0.50 Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Openstack-Api-Version: compute 2.90 Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Openstack-System-Scope: None Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: User-Agent: python-novaclient Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Auth-Token: gAAAAABjDWyrCwZ7clcCLFUVCQ9TXtxMn2mI2uJ6IcKP-9iYzIweKMzzgI5do49A0LFF1sFr89x90vMm0BAaDcdF_amLJmUV84s0-6r-rLjh1iZg1gLe_yAIcsWUanqWbV4v_2ifu81FGGsgKHrL9xWTqCaRN-Fc6mkMcbY5ljnnGLHFDcuuK8s Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Domain-Id: None Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Domain-Name: None Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Identity-Status: Confirmed Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Is-Admin-Project: True Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Domain-Id: default Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Domain-Name: Default Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Project-Name: admin Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Role: member,reader,admin Aug 30 01:49:32.452819 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Roles: member,reader,admin Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e7c73461b5344be681351a70b1beafa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e7c73461b5344be681351a70b1beafa9"}]}] Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Tenant: admin Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Tenant-Id: e7c73461b5344be681351a70b1beafa9 Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-Tenant-Name: admin Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User: admin Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Domain-Id: default Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Domain-Name: Default Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Id: a8eb78c86bca426c9163deb9994b5cec Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: X-User-Name: admin Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: method: > Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: exception: Flavor 451 could not be found. Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: action_args: {'id': '451'} Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:49:32.454311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:32.455216 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: ERROR nova.api.openstack.wsgi Aug 30 01:49:32.456567 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-79b443fd-40b7-45f0-b41d-512fe2375023 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:49:32.457829 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-79b443fd-40b7-45f0-b41d-512fe2375023 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011834 Aug 30 01:49:32.457829 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 01:49:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 01:49:33.404028 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:33.405634 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 30 01:49:33.406042 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:49:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:33.917563 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-aa68c800-520a-4d23-98fd-db71d2627f96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:49:33.937495 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-aa68c800-520a-4d23-98fd-db71d2627f96 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.396881 Aug 30 01:49:33.938031 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 30 01:49:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:49:34.899310 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:34.900353 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 30 01:49:34.900752 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:35.417493 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-3e2346c4-db86-4140-a116-de6917ad1696 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:49:35.435859 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-3e2346c4-db86-4140-a116-de6917ad1696 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.396404 Aug 30 01:49:35.436978 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 30 01:49:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:49:36.402715 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:36.403717 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 30 01:49:36.404109 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:49:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:36.923405 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-491a77c7-0bed-4510-8628-b9ea543a4ada admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:49:36.942636 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-491a77c7-0bed-4510-8628-b9ea543a4ada admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404349 Aug 30 01:49:36.943175 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 30 01:49:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:49:37.905867 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:37.906871 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Aug 30 01:49:37.907263 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:38.431460 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-e19324a8-908e-45b1-b281-72cc577cf00f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:49:38.451172 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-e19324a8-908e-45b1-b281-72cc577cf00f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.399819 Aug 30 01:49:38.451718 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 30 01:49:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:49:39.409862 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:39.410869 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 30 01:49:39.411267 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:49:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:49:39.932035 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-253c0a49-8ad7-4ab4-a688-c80594ca0c51 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:49:39.952799 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-253c0a49-8ad7-4ab4-a688-c80594ca0c51 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406097 Aug 30 01:49:39.953327 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Tue Aug 30 01:49:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:50:32.884190 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:50:32.885202 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-f9324a9e-6ccc-4c64-b2a6-f91518c6727f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 30 01:50:32.885604 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 30 01:50:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:50:32.896865 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:50:33.271964 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-76df0ff6-28e7-4058-a351-b2e2f3264718 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:50:33.292320 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-76df0ff6-28e7-4058-a351-b2e2f3264718 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400042 Aug 30 01:50:33.292869 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 30 01:50:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:50:33.314869 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG dbcounter [-] [105393] Writing DB stats nova_api:SELECT=14 {{(pid=105393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:50:33.318838 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-2ccd1526-054d-4ed6-bbd5-cb36fb22a2d1 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:50:33.326604 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-2ccd1526-054d-4ed6-bbd5-cb36fb22a2d1 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013992 Aug 30 01:50:33.327119 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1283 bytes} [Tue Aug 30 01:50:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:50:33.338715 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-93fad58a-8db4-4f85-8297-db065530ac6b admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:50:33.346174 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-93fad58a-8db4-4f85-8297-db065530ac6b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011009 Aug 30 01:50:33.346678 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1286 bytes} [Tue Aug 30 01:50:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:50:33.357728 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-8dbe7661-058e-4b06-bee9-b9e20609e125 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:50:33.365563 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-8dbe7661-058e-4b06-bee9-b9e20609e125 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011265 Aug 30 01:50:33.366069 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1286 bytes} [Tue Aug 30 01:50:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:50:33.377970 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-6da65935-07c1-43bc-81d4-dddef2bcc64d admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:50:33.385224 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-6da65935-07c1-43bc-81d4-dddef2bcc64d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011215 Aug 30 01:50:33.385750 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1283 bytes} [Tue Aug 30 01:50:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:53:28.298969 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-8dbe7661-058e-4b06-bee9-b9e20609e125 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:53:28.300018 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-8dbe7661-058e-4b06-bee9-b9e20609e125 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 30 01:53:28.300454 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:53:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:53:28.441456 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writing DB stats nova_api:SELECT=6 {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:53:28.596913 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-b5f06646-dfd7-4be0-a0a4-ed81c7853ba0 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:53:28.600445 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-b5f06646-dfd7-4be0-a0a4-ed81c7853ba0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:28.600928 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-b5f06646-dfd7-4be0-a0a4-ed81c7853ba0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:28.601353 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-b5f06646-dfd7-4be0-a0a4-ed81c7853ba0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:28.602061 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-b5f06646-dfd7-4be0-a0a4-ed81c7853ba0 admin admin] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:28.602509 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-b5f06646-dfd7-4be0-a0a4-ed81c7853ba0 admin admin] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:28.602923 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-b5f06646-dfd7-4be0-a0a4-ed81c7853ba0 admin admin] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:28.640670 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-b5f06646-dfd7-4be0-a0a4-ed81c7853ba0 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200830 Aug 30 01:53:28.641238 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 01:53:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:53:29.468795 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-8dbe7661-058e-4b06-bee9-b9e20609e125 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:53:29.469860 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-8dbe7661-058e-4b06-bee9-b9e20609e125 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 30 01:53:29.470257 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:53:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:53:29.657752 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-e55a96d3-75f8-4c61-a0b3-2d9a9e82c35a admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:53:29.661198 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-e55a96d3-75f8-4c61-a0b3-2d9a9e82c35a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:29.661668 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-e55a96d3-75f8-4c61-a0b3-2d9a9e82c35a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:29.662113 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-e55a96d3-75f8-4c61-a0b3-2d9a9e82c35a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:29.662820 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-e55a96d3-75f8-4c61-a0b3-2d9a9e82c35a admin admin] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:29.663264 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-e55a96d3-75f8-4c61-a0b3-2d9a9e82c35a admin admin] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:29.663679 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-e55a96d3-75f8-4c61-a0b3-2d9a9e82c35a admin admin] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:29.682949 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-e55a96d3-75f8-4c61-a0b3-2d9a9e82c35a admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075585 Aug 30 01:53:29.683492 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 01:53:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:53:40.925687 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-8dbe7661-058e-4b06-bee9-b9e20609e125 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:53:40.926723 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-8dbe7661-058e-4b06-bee9-b9e20609e125 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 30 01:53:40.927115 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 36/73] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:53:41.073684 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writing DB stats nova_cell0:SELECT=4 {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:53:41.074429 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writing DB stats nova_cell1:SELECT=4 {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:53:41.075057 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG dbcounter [-] [105394] Writing DB stats nova_api:SELECT=8 {{(pid=105394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:53:41.129370 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-6720311f-eb45-42a7-bd7e-3c9305b3e230 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:53:41.132771 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-6720311f-eb45-42a7-bd7e-3c9305b3e230 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:41.133246 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-6720311f-eb45-42a7-bd7e-3c9305b3e230 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:41.133702 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-6720311f-eb45-42a7-bd7e-3c9305b3e230 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:41.134491 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-6720311f-eb45-42a7-bd7e-3c9305b3e230 admin admin] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:41.134883 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-6720311f-eb45-42a7-bd7e-3c9305b3e230 admin admin] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:41.135296 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-6720311f-eb45-42a7-bd7e-3c9305b3e230 admin admin] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:41.161139 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-6720311f-eb45-42a7-bd7e-3c9305b3e230 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.094548 Aug 30 01:53:41.161686 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 38/74] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 01:53:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:53:42.008573 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: DEBUG nova.api.openstack.wsgi [None req-8dbe7661-058e-4b06-bee9-b9e20609e125 admin admin] Calling method '>' {{(pid=105393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:53:42.009580 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: INFO nova.api.openstack.requestlog [None req-8dbe7661-058e-4b06-bee9-b9e20609e125 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 30 01:53:42.010143 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: [pid: 105393|app: 0|req: 37/75] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 30 01:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:53:42.203267 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG nova.api.openstack.wsgi [None req-054fdcc4-6ee7-46fa-b3f4-ebe63b369612 admin admin] Calling method '>' {{(pid=105394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:53:42.206786 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-054fdcc4-6ee7-46fa-b3f4-ebe63b369612 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:42.207311 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-054fdcc4-6ee7-46fa-b3f4-ebe63b369612 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:42.207746 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-054fdcc4-6ee7-46fa-b3f4-ebe63b369612 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:42.208517 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-054fdcc4-6ee7-46fa-b3f4-ebe63b369612 admin admin] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:42.208993 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-054fdcc4-6ee7-46fa-b3f4-ebe63b369612 admin admin] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:42.209412 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: DEBUG oslo_concurrency.lockutils [None req-054fdcc4-6ee7-46fa-b3f4-ebe63b369612 admin admin] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:42.231979 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: INFO nova.api.openstack.requestlog [None req-054fdcc4-6ee7-46fa-b3f4-ebe63b369612 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079663 Aug 30 01:53:42.232550 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: [pid: 105394|app: 0|req: 39/76] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 30 01:53:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:54:38.599589 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: Tue Aug 30 01:54:38 2022 - graceful shutdown triggered... Aug 30 01:54:38.600102 dv-cinder-819668-6-iscsi devstack@n-api.service[105393]: Gracefully killing worker 1 (pid: 105393)... Aug 30 01:54:38.600507 dv-cinder-819668-6-iscsi devstack@n-api.service[105394]: Gracefully killing worker 2 (pid: 105394)... Aug 30 01:54:38.602621 dv-cinder-819668-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 01:54:39.600424 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: worker 1 buried after 1 seconds Aug 30 01:54:39.600424 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: worker 2 buried after 1 seconds Aug 30 01:54:39.600424 dv-cinder-819668-6-iscsi devstack@n-api.service[105392]: goodbye to uWSGI. Aug 30 01:54:39.601982 dv-cinder-819668-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 01:54:39.602538 dv-cinder-819668-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 01:54:39.605353 dv-cinder-819668-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 01:54:39.615134 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 01:54:39.617244 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 01:54:39 2022] *** Aug 30 01:54:39.617244 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 01:54:39.617244 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 01:54:39.617244 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: nodename: dv-cinder-819668-6-iscsi Aug 30 01:54:39.617244 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: machine: x86_64 Aug 30 01:54:39.617244 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: clock source: unix Aug 30 01:54:39.617244 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: pcre jit disabled Aug 30 01:54:39.617244 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: detected number of CPU cores: 4 Aug 30 01:54:39.617244 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: current working directory: / Aug 30 01:54:39.617244 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: detected binary path: /usr/bin/uwsgi-core Aug 30 01:54:39.618004 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: your processes number limit is 47680 Aug 30 01:54:39.618004 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: your memory page size is 4096 bytes Aug 30 01:54:39.618004 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: detected max file descriptor number: 2048 Aug 30 01:54:39.618004 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: lock engine: pthread robust mutexes Aug 30 01:54:39.618004 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: thunder lock: enabled Aug 30 01:54:39.618004 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 01:54:39.618004 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 01:54:39.656250 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: Python main interpreter initialized at 0x55a7a54f79c0 Aug 30 01:54:39.656435 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: python threads support enabled Aug 30 01:54:39.656435 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: your server socket listen backlog is limited to 100 connections Aug 30 01:54:39.656435 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: your mercy for graceful operations on workers is 90 seconds Aug 30 01:54:39.656677 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 01:54:39.656677 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: *** Operational MODE: preforking *** Aug 30 01:54:39.656949 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: *** uWSGI is running in multiple interpreter mode *** Aug 30 01:54:39.656949 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: spawned uWSGI master process (pid: 120379) Aug 30 01:54:39.657148 dv-cinder-819668-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 01:54:39.658997 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: spawned uWSGI worker 1 (pid: 120391, cores: 1) Aug 30 01:54:39.658997 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: spawned uWSGI worker 2 (pid: 120392, cores: 1) Aug 30 01:54:39.658997 dv-cinder-819668-6-iscsi devstack@n-api.service[120379]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 01:54:40.338988 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:54:40.341821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:54:41.500228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:54:41.500228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: from cryptography.utils import int_from_bytes Aug 30 01:54:41.500978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:54:41.500978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: from cryptography.utils import int_from_bytes Aug 30 01:54:41.523565 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:54:41.523565 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: from cryptography.utils import int_from_bytes Aug 30 01:54:41.524105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:54:41.524105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: from cryptography.utils import int_from_bytes Aug 30 01:54:43.934125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:54:43.934731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:54:43.934922 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:54:43.935282 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:54:43.935543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:54:43.935931 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.936280 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.936606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.936925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.937416 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.937732 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.938062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.938385 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.938716 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.938981 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.939298 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.939671 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819668-6-iscsi {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.939999 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.940353 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.940669 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.940992 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.941302 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.941618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.941932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.942441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.942897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.943210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.943525 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.943871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.944186 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.944539 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.944863 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.945174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.945503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.945820 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.946232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819668-6-iscsi {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.946553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.946865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.947178 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.947602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.947915 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.948223 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.948568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.948892 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.949212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.949543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.949865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.950193 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.950514 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.950818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.951127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.951437 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.951757 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.952061 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.952396 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.952651 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.952959 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.953282 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.953600 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.953928 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.954180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.954426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.954746 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.955067 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.955413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.955722 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.956029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.956362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.956670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.956978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.957323 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.957624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.957944 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.958262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.958584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.958891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.959211 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.959621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.959873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.960185 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.960555 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.960874 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.961181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.961501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.961821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.962130 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.962440 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.962745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.963061 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.963404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.963709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.963961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.964294 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.964592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.964907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.965213 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.965517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.965823 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.966122 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.966428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.966733 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.967038 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.967342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.967646 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.967950 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.968276 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.968586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.968890 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.969209 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.969528 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.969834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.970145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.970449 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.971259 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.971589 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.971896 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.972200 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.972556 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.972865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.973172 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.973489 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.973797 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.974103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.974420 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.974721 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.975026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.975342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.975647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.975953 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.976285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.976579 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.976883 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.977187 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.977493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.977797 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.978096 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.978414 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.978732 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.979039 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.979347 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.979652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.979972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.980332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.980561 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:54:43.981011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.981115 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:54:43.981215 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.981306 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.981389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:54:43.981621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.981715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:54:43.981928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:54:43.982027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.982259 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.982357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.982580 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.982692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.982890 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.983057 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.983198 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.983344 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.983515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.983690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.983841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.984008 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.984148 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.984362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.984502 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.984702 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.984840 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.985021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.985167 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.985303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.985442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.985590 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.985730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.985899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819668-6-iscsi {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.986043 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.986227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.986395 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.987083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.987244 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.987385 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.987522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.987708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.987850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.988001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.988147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.988354 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.988493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.988667 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.988831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.989083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.989233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.989414 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.989556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.989781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.990006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.990154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.990306 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.990445 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.990589 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.990743 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.990889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.991027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.991175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.991319 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.991455 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.991603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.991747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.991890 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.992035 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.992173 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.992343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.992495 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.992622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819668-6-iscsi {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.992810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.992943 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.993124 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.993258 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.993438 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.993573 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.993752 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.993987 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.994129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.994299 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.994442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.994610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.994743 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.994931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.995071 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.995257 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.995355 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.995566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.995656 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.995894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.995997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.996207 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.996338 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.996545 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.996639 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.996856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.996960 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.997157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.997254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.997459 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.997547 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.997766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.997865 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.998078 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.998168 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.998380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.998471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.998688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.998788 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.999200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.999297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.999506 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.999607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:43.999830 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:43.999934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.000150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.000289 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.000499 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.000600 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.000755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.000855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.001007 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.001105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.001327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.001432 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.001648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.001741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.001957 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.002048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.002294 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.002401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.002603 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.002696 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.002909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.003003 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.003212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.003357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.003516 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.003607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.003822 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.003919 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.004128 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.004227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.004472 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.004571 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.004786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.004883 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.005095 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.005189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.005403 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.005499 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.005712 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.005801 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.006036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.006128 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.006346 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.006442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.006654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.006754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.006989 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.007088 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.007307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.007396 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.007609 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.007708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.007927 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.008017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.008265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.008371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.008578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.008667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.008879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.008978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.009190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.009324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.009493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.009583 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.009795 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.009908 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.010100 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.010243 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.010381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.010519 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.010661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.010797 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.010925 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.011062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.011244 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.011375 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.011549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.011650 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.011856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.011946 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.012161 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.012273 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.012488 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.012583 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.012792 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.012932 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.013095 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.013193 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.013397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.013497 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.013701 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.013799 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.014005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.014105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.014308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.014408 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.014614 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.014705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.014919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.015019 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.015226 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.015319 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.015546 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.015647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.015867 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.016038 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.016170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.016322 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.016491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.016584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.016795 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.016889 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.017099 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.017190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.017417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.017515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.017747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.017844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.018055 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.018154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.018365 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.018461 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.018675 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.018772 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.018982 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.019087 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.019300 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.019398 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.019605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.019695 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.019909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.020012 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.020227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.020336 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.020550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.020650 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.020858 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.020958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.021178 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.021268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.021486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.021584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.021842 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.021949 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.022098 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.022189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.022403 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.022501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.022708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.022807 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.023013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.023109 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.023315 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.023450 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.023621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.023716 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.023922 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.024020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.024230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.024373 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.024572 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.024664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.024878 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.024977 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.025183 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.025279 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.025485 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.025625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.025798 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.025889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:54:44.026127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.026274 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.026457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.026556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.026767 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.026906 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.027078 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.027178 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.027397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.027488 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.027705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.027803 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.028014 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.028114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.028347 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.028453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.028765 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.028874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.028967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.029064 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.029256 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.029348 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.029599 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.029709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.029879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.029983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.030188 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.030326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.030492 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.030623 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.030813 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.030953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.031122 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.031260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.031426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.031563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.031727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.031859 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.032036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.032167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.032379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.032520 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.032690 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.032826 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.033013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.033145 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.033864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.034009 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.034173 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.034301 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.034484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.034622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.034810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.035006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.035136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.035268 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.035411 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.035538 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.035704 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.035848 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.036009 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.036145 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.036377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.036509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.036693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.036833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.037001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.037168 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.037319 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.037458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.037638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.037776 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.037948 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.038038 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.038264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.038363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.038575 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.038666 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.038883 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.038971 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.039194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.039282 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.039507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.039597 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.039817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.039956 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.040127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.040227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.040461 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.040565 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.040770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.040869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.041082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.041182 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.041395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.041491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.041701 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.041791 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.042012 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.042111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.042324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.042413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.042624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.042720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.042931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.043078 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.043239 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.043370 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.043548 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.043814 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.043913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.044148 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.044261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.044491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.044583 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.044811 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.045030 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.045121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.045202 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.045443 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.045540 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.045753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.045857 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.046067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.046162 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.046386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.046517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.046692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.046835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.046982 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.047117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.047290 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.047388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.047594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.047693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.047898 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.047987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.048199 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.048355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.048530 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.048629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.048833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.048994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.049196 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.049289 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.049498 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.049621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.049841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.049939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.050145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.050237 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.050451 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.050586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.050761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.050863 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.051064 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.051154 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.051376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.051468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.051678 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.051776 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.051999 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.052096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.052332 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.052426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.052637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.052739 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.052942 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.053032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.053244 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.053341 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.053587 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.053693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.053891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.053982 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.054212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.054352 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.054517 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.054612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.054827 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.054961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.055132 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.055262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.055438 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.055584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.055743 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.055833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.056048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.056138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.056374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.056467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.056678 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.056766 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.056982 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.057082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.057288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.057387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.057591 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.057697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.057901 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.058010 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.058209 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.058307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.058513 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.058601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.058819 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.058918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.059117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.059213 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.059427 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.059518 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.059730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.059834 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.060045 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.060179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.060382 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.060483 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.060686 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.060796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.060987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.061085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.061303 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.061406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.061610 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.061715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.061912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.062015 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.062221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.062317 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.062521 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.062624 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.062836 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.062941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.063140 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.063257 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.063443 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.063578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.063796 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.063897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.064053 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.064165 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.064390 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.064489 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.065227 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.065362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.065552 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.065703 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.065858 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.065949 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.066161 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.066250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.066466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.066567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.066778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.066877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.067082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.067174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.067384 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.067487 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.067695 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.067793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.068018 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.068125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.068353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.068459 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.068658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.068749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.068967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.069057 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.069268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.069359 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.069571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.069663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.069875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.069966 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.070185 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.070287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.070487 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.070579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.070788 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.070881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.071090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.071196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.071392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.071491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.071697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.071786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.072011 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.072110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.072342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.072449 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.072649 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.072749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.072954 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.073054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.073257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.073357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.073596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.073694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.073897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.073993 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.074206 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.074297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.074523 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.074644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.074833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.074931 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.075143 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.075247 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.075450 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.075622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.075770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.075859 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.076058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.076150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.076387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.076481 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.076692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.076781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.077004 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.077105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.077314 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.077453 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.077617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.077707 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.077917 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.078008 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.078231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.078329 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.078538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.078635 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.078850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.078949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.079172 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.079270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.079494 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.079584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.079802 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.079902 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.080106 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.080271 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.080999 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.081102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.081310 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.081410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.081618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.081708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.081924 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.082013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.082231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.082332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.082539 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.082630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.082852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.082945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.083161 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.083328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.083472 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.083571 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.083784 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.083877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.084091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.084183 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.084427 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.084531 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.084741 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.084884 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.085041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.085142 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.085362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.085452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.085671 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.085786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.085977 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.086097 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.086288 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.086388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.086589 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.086681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.086899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.086991 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.087201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.087290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.087525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.087630 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.087836 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.087933 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.088148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.088273 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.088486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.088602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.088793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.088892 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.089106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.089205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.089424 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.089530 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.089742 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.089994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.090092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.090332 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.090458 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.090650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.090772 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.090972 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.091107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.091292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.091395 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.091636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.091735 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.091968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.092072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.092299 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.092394 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.092618 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.092721 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.092923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.093021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.093230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.093377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.093533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.093632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.093839 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.093938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.094141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.094231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.094443 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.094533 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.094755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.094882 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.095064 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.095168 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.095375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.095475 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.095678 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.095889 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.096020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.096202 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.096375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.096539 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.096642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.096862 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.096957 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.097183 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.097281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.097506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.097635 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.097811 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.097903 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.098125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.098216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.098436 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.098536 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.098742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.098833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.099046 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.099137 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.099352 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.099451 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.099664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.099754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.099970 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.100070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.100317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.100429 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.100641 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.100733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.100957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.101062 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.101281 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.101382 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.101585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.101705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.101909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.102030 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.102215 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.102338 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.102521 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.102658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.102824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.102980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.103136 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.103285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.103445 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.103590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.103752 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.103900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.104063 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.104205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.104396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.104536 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.104709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.104840 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.105020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.105149 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.105325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.105462 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.105636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.105773 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.105940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.106083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.106254 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.106395 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.106563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.106656 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.106868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.106967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.107170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.107261 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.107481 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.107581 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.107789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.107880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.108092 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.108191 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.108426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.108529 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.108729 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.108828 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.109046 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.109151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.109352 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.109443 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.109657 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.109748 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.109961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.110060 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.110277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.110369 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.110588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.110679 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.110892 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.111064 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.111190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.111306 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.111571 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.111714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.111882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.111983 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.112189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.112313 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.112527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.112619 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.112835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.112928 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.113141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.113235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.113454 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.113551 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.113778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.113870 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.114082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.114173 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.114388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.114539 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.114697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.114796 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.115000 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.115170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.115305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.115404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.115608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.115706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.115915 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.116005 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.116216 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.116358 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.116541 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.116647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.116841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.116938 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.117144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.117241 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.117450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.117550 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.117767 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.117891 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.118076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.118179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.118379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.118477 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.118682 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.118779 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.118984 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.119083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.119326 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.119425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.119629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.119729 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.119954 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.120044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.120281 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.120376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.120607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.120708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.120925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.121024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.121235 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.121375 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.121549 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.121648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.121863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.121961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.122170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.122268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.122481 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.122580 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.122789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.122887 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.123097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.123228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.124492 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.124613 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.124707 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.124800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.124892 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.124983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.124983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.125224 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.125339 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.125448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.125562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.125684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.125802 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.125894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.125977 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.126105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.126287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.126394 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.126598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.126698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.126909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.127008 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.127756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.127900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.128068 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.128170 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.128406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.128500 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.128721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.128815 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.129037 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.129132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.129348 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.129439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.129660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.129820 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.129974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.130074 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.130286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.130378 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.130599 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.130698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.130913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.131005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.131220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.131311 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.131548 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.131647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.131863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.131962 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.132172 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.132296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.132512 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.132605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.132819 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.132910 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.133129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.133297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.133436 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.133533 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.133747 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.133868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.134060 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.134182 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.134373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.134496 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.134683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.134803 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.134996 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.135115 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.135310 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.135430 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.135636 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.135735 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.135974 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.136068 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.136320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.136429 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.136641 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.136778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.136960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.137092 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.137279 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.137407 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.137718 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.137822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.138027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.138120 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.138335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.138430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.138648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.138748 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.138974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.139066 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.139282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.139381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.139590 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.139694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.139898 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.140036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.140228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.140379 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.140556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.140661 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.140877 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.140968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.141189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.141281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.141498 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.141591 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.141827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.141919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.142140 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.142297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.142445 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.142609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.143296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.143524 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.143616 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.143852 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.144176 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.144304 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.144533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.144627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.144843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.144942 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.145160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.145256 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.145477 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.145579 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.145805 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.145900 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.146117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.146197 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.146431 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.146529 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.146739 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.146838 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.147046 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.147137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.147361 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.147461 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.147673 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.147775 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.147978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.148088 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.148304 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.148441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.148617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.148722 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.148927 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.149041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.149230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.149354 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.149540 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.149678 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.149844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.150004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.150169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.150317 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.150476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.150625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.150780 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.150939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.151086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.151246 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.151397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.151555 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.151705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.151879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.152009 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.152188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.152324 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.152529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.152622 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.152840 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.152939 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.153151 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.153251 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.153457 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.153550 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.153790 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.153884 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.154097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.154189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.154400 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.154490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.154707 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.154798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.155024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.155127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.155349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.155478 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.155654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.155745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.155958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.156053 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.156292 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.156399 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.156605 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.156708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.156913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.157013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.157219 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.157313 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.157524 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.157628 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.157869 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.157966 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.158174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.158330 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.158525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.158734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.158856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.159073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.159185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.159398 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.159503 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.159736 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.159827 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.160070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.160169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.160407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.160515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.160718 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.160809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.161027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.161120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.161356 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.161461 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.161668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.161810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.161982 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.162081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.162287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.162386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.162595 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.162694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.162903 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.163003 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.163214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.163314 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.163519 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.163611 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.163823 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.163924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.164127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.164220 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.164463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.164567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.164773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.164871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.165081 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.165180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.165392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.165491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.165699 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.165790 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.166006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.166106 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.166312 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.166410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.166651 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.166755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.166957 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.167056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.167270 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.167366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.167588 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.167692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.167897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.167989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.168207 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.168326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.168543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.168688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.168852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.168944 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.169167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.169265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.169486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.169578 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.169798 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.169896 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.170104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.170202 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.170417 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.170515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.170733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.170833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.171050 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.171149 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.171369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.171462 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.171731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.171894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.172051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.172225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.172397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.172565 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.172709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.172883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.173029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.173199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.173338 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.173516 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.173664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.173831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.174029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.174173 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.174360 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.174490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.174685 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.174801 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.174994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.175115 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.175302 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.175446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.175606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.175773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.175916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.176101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.176236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.176464 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.176647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.176786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.177104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.177423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.177702 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.177870 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.178034 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.178183 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.178350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.178499 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.178654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.178803 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.178957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.179117 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.179267 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.179414 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.179568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.179723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.179881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.180038 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.180187 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.180377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.180528 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.180675 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.180822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.180981 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.181137 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.181367 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.181537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.181686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.181846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.182016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.182165 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.182313 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.182468 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.182615 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.182783 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.182936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.182936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.183096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.183276 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.183370 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.183596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.183697 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.183916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.184016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.184295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.184474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.184608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.184800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.184934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.185139 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.185231 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.185472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.185568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.185800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.185893 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.186119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.186217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.186443 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.186543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.186774 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.186875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.187083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.187208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.187392 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.187484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.187708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.187800 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.188015 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.188114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.188353 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.188447 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.188668 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.188771 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.188981 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.189087 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.189293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.189392 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.190116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.190259 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.190446 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.190578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.190756 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.191061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.191153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.191387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.191521 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.191708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.191801 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.192023 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.192114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.192389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.192508 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.192689 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.192780 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.192997 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.193139 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.193308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.193474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.193620 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.193711 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.193929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.194028 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.194240 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.194344 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.194552 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.194643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.194858 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.194961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.195164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.195255 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.195477 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.195569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.195788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.195914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.196096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.196197 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.196436 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.196537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.196744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.196834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.197069 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.197169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.197375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.197465 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.197682 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.197772 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.197990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.198082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.198302 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.198401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.198608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.198708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.198915 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.199013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.199223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.199322 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.199529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.199629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.199784 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:54:44.199875 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.200132 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.200473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.200781 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.201094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.201399 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.201709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.202065 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.202393 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.202702 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.203013 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.203331 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.203645 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.203970 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.204305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.204625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.204978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.205356 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.206385 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.206907 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.207043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.207370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.207705 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.208017 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.208360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.208676 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.209004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.209322 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.209638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.209952 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.210268 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.210587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.210899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.211209 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.211522 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.211834 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.212146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.212486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.212799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.213112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.213423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.213740 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.214090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.214420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.215676 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.216006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.216362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.216687 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.217012 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.217329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.217646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.217968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.218302 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.218622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.218933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.219361 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.219679 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.220001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.220345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.220669 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.221022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.221349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.221663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.221987 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.222303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.222634 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.222978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.223313 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.223642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.223953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.224281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.224595 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.224909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.225230 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.225543 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.225851 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.226156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.226470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.226782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.227091 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.227400 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.227708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.228020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.228347 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.228656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.228964 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.229270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.229578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.229903 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.230202 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.230515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.230824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.231130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.231438 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.231742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.232078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.232452 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.232774 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.233100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.233413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.233740 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.234054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.234379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.234703 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.235020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.235332 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.235667 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.235980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.236311 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.236654 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.236974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.237300 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.237602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.237914 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.238243 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.238551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.238878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.239195 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.239515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.239833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.240147 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.240506 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.240820 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.241134 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.241507 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.241756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.242066 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.242381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.242693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.243003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.243319 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.243635 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.243960 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.244308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.244622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.244949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.245277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.245627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.245941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.246289 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.246622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.246945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.247343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.247550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:54:44.247815 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:54:44.262826 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO dbcounter [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Registered counter for database nova_api Aug 30 01:54:44.290130 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_db.sqlalchemy.engines [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:54:44.296787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writer thread running {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:54:44.310078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO dbcounter [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Registered counter for database nova_api Aug 30 01:54:44.331220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_db.sqlalchemy.engines [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:54:44.339932 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writer thread running {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:54:44.355771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.context [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99d86a54-00a5-438e-9f83-1aa5b257911d(cell1) {{(pid=120392) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:54:44.360192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:54:44.360691 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:54:44.363347 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:54:44.364171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:54:44.364640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:54:44.366813 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:54:44.368894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO dbcounter [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Registered counter for database nova_cell0 Aug 30 01:54:44.373166 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO dbcounter [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Registered counter for database nova_cell1 Aug 30 01:54:44.384783 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_db.sqlalchemy.engines [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:54:44.386892 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_db.sqlalchemy.engines [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:54:44.393703 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writer thread running {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:54:44.416400 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.context [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99d86a54-00a5-438e-9f83-1aa5b257911d(cell1) {{(pid=120391) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:54:44.420522 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:54:44.420999 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:54:44.422610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:54:44.423344 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:54:44.423796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:54:44.426392 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:54:44.428485 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO dbcounter [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Registered counter for database nova_cell0 Aug 30 01:54:44.434311 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO dbcounter [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Registered counter for database nova_cell1 Aug 30 01:54:44.444216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_db.sqlalchemy.engines [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:54:44.447440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_db.sqlalchemy.engines [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:54:44.454728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writer thread running {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:54:44.456901 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writer thread running {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:54:44.547392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writer thread running {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:54:44.557284 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO dbcounter [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Registered counter for database nova_cell0 Aug 30 01:54:44.563984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_db.sqlalchemy.engines [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:54:44.569723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writer thread running {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:54:44.610100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO dbcounter [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Registered counter for database nova_cell0 Aug 30 01:54:44.617426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_db.sqlalchemy.engines [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:54:44.622653 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writer thread running {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:54:44.892852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: WARNING keystonemiddleware.auth_token [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:54:44.900050 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: WARNING keystonemiddleware.auth_token [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:54:44.950028 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: WARNING keystonemiddleware.auth_token [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:54:44.957449 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: WARNING keystonemiddleware.auth_token [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:54:45.246796 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: WARNING keystonemiddleware.auth_token [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:54:45.253938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: WARNING keystonemiddleware.auth_token [None req-b01036c7-3434-4232-abd3-ab583dc6e140 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:54:45.259327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7a54f79c0 pid: 120392 (default app) Aug 30 01:54:45.336214 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: WARNING keystonemiddleware.auth_token [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:54:45.342287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: WARNING keystonemiddleware.auth_token [None req-672d0a1a-f337-4b13-9e65-39aea1543887 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:54:45.347767 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7a54f79c0 pid: 120391 (default app) Aug 30 01:55:18.800815 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:18.801801 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:18.802344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:18.803280 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:19.757455 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-63e331d0-945a-460f-aa51-86df4ec55d62 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Action: 'create', calling method: .version_select at 0x7f3b09065e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-246348917"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:21.181376 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-63e331d0-945a-460f-aa51-86df4ec55d62 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.395671 Aug 30 01:55:21.182305 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1155 bytes} [Tue Aug 30 01:55:18 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2399 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 01:55:21.204890 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=3 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:21.205705 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=3 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:21.206422 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=3 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:21.207157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=3 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:21.491166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-58fa7fdb-aadc-45a8-b1d5-20c83d710100 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b0905da60>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:23.036329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-58fa7fdb-aadc-45a8-b1d5-20c83d710100 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 345 microversion: 2.1 time: 1.842565 Aug 30 01:55:23.046007 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 1/2] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:21 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 345 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:23.052865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9c4a6edb-4512-40e2-a07d-59d4053726e6 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Action: 'create', calling method: .version_select at 0x7f3b08eebc10>, body: {"snapshot": {"volume_id": "888a6803-e37e-4569-87b3-ee5363a1654d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-910489268"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:23.699541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9c4a6edb-4512-40e2-a07d-59d4053726e6 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.615717 Aug 30 01:55:23.699541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 2/3] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Aug 30 01:55:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:55:23.700230 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-918d139f-c5ce-4739-87ca-aca52855d952 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08f26ca0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:23.883086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-918d139f-c5ce-4739-87ca-aca52855d952 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 200 len: 286 microversion: 2.1 time: 0.213355 Aug 30 01:55:23.884693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 01:55:23 2022] GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:23.904235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6f1237d9-30df-4e8b-907e-6c3dd3c6b461 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08f01dc0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:24.220844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6f1237d9-30df-4e8b-907e-6c3dd3c6b461 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.328653 Aug 30 01:55:24.222143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 3/5] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 30 01:55:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:24.233983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c71fde8f-bbca-4585-8204-f9d57ad7d13d tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08edf430>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:24.301766 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c71fde8f-bbca-4585-8204-f9d57ad7d13d tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 200 len: 286 microversion: 2.1 time: 0.072096 Aug 30 01:55:24.302318 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 3/6] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 01:55:24 2022] GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:25.315001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c3f1fbf6-921e-4d2e-98f7-d539319ac0e9 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08f01af0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:25.372619 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c3f1fbf6-921e-4d2e-98f7-d539319ac0e9 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 200 len: 286 microversion: 2.1 time: 0.061844 Aug 30 01:55:25.373940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 01:55:25 2022] GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:26.388944 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ae526444-0e3a-44c2-a324-278349411b43 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08edfaf0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:26.629997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ae526444-0e3a-44c2-a324-278349411b43 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 200 len: 286 microversion: 2.1 time: 0.245563 Aug 30 01:55:26.634059 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 01:55:26 2022] GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 286 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:27.656575 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f9d704ce-024e-4f74-89fe-c4fcea90c245 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08f01550>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:27.718547 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f9d704ce-024e-4f74-89fe-c4fcea90c245 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 200 len: 286 microversion: 2.1 time: 0.076245 Aug 30 01:55:27.719377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 5/9] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 01:55:27 2022] GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:28.732287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-32cadbfb-4114-4a0b-8cd5-d1212e2a21f0 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08f26c10>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:28.810496 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-32cadbfb-4114-4a0b-8cd5-d1212e2a21f0 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 200 len: 286 microversion: 2.1 time: 0.082394 Aug 30 01:55:28.811060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 5/10] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 01:55:28 2022] GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:29.824292 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-843ee632-1282-4877-885a-492f11136626 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08eebe50>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:29.931217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-843ee632-1282-4877-885a-492f11136626 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 200 len: 286 microversion: 2.1 time: 0.111821 Aug 30 01:55:29.931770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 6/11] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 01:55:29 2022] GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:30.086930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a3abcb35-7a51-4296-abd0-0159afa6d216 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: .version_select at 0x7f3b08edf790>, body: {"keypair": {"name": "tempest-keypair-1795287767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbJpEol0ZdK3OeSmOKkKME805MUoxUgP3dMq+F09LdBNbrGT5QStEdvtLL74Ddmc892huCz57+3TGU4Hc3fxUAqdGCQ6AWg2NNviiZO40/z6zIP0IREGz4MdQOZ+4ZIAQ=="}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:30.193490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-a3abcb35-7a51-4296-abd0-0159afa6d216 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for project b9d96d936ce8417197008a59da394df7. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:55:30.200577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-a3abcb35-7a51-4296-abd0-0159afa6d216 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for user a06de37941264b979a3bd5aaf84ec73c and project b9d96d936ce8417197008a59da394df7. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:55:30.300402 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a3abcb35-7a51-4296-abd0-0159afa6d216 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.429062 Aug 30 01:55:30.306116 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 6/12] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 01:55:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:55:30.945098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0e22b810-397c-41cc-ba6c-e114c8bb5d55 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08eebaf0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:31.036501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0e22b810-397c-41cc-ba6c-e114c8bb5d55 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 200 len: 287 microversion: 2.1 time: 0.095700 Aug 30 01:55:31.037670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 01:55:30 2022] GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:31.048490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-73bbd449-e4e1-444d-97ea-4476dbf21261 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08e783a0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:31.241356 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-73bbd449-e4e1-444d-97ea-4476dbf21261 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 202 len: 0 microversion: 2.1 time: 0.196576 Aug 30 01:55:31.242333 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 7/14] 10.222.0.50 () {58 vars in 1254 bytes} [Tue Aug 30 01:55:31 2022] DELETE /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:55:31.251173 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2ac9d46a-d2e4-4a39-b797-bc8c44355aa8 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08f01280>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:31.306960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2ac9d46a-d2e4-4a39-b797-bc8c44355aa8 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 200 len: 286 microversion: 2.1 time: 0.060403 Aug 30 01:55:31.316680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 8/15] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 01:55:31 2022] GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:32.327744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0ffe75b2-4f59-4b35-bbfc-205ad7b418cf tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08e78a60>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:32.385168 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-0ffe75b2-4f59-4b35-bbfc-205ad7b418cf tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] HTTP exception thrown: Snapshot 6517f9e0-bc92-4de2-9e00-e3c486409974 could not be found. Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0ffe75b2-4f59-4b35-bbfc-205ad7b418cf tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Request method failure captured: Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 HTTP/1.1 Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4GTbp5L6KoPobu7SVGyIWBcPFahbqby9U-9GPYjMI-dOdCr4_u_--WIYPNPKLg8HyjZQayr3IcWXd3GEBz--qCHD2PaRCKY014G6t9xsK3IWGyJhPRaDetl2RaMhiZJoiHkusgXq0PIi_d3aeFDhv9Uo4W_PgyJDNtC4RUQ__HUCU Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 56a61719b5c8402b9542dacad4242644 Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 01:55:32.389950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a61719b5c8402b9542dacad4242644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a61719b5c8402b9542dacad4242644"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/56a61719b5c8402b9542dacad4242644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_56a61719b5c8402b9542dacad4242644"}]}] Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 56a61719b5c8402b9542dacad4242644 Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-VolumesSnapshotsTestJSON-1298583182-project Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: b74a7caa5628414bbbf9bab161625f0d Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298583182-project Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Snapshot 6517f9e0-bc92-4de2-9e00-e3c486409974 could not be found. Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '6517f9e0-bc92-4de2-9e00-e3c486409974'} Aug 30 01:55:32.391102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6517f9e0-bc92-4de2-9e00-e3c486409974 could not be found. (HTTP 404) (Request-ID: req-bf0fa1a4-ed5f-4c41-80fb-2fa9b6e70d53) Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:32.391800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:55:32.393282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6517f9e0-bc92-4de2-9e00-e3c486409974 could not be found. Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 01:55:32.394194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6517f9e0-bc92-4de2-9e00-e3c486409974 could not be found. Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6517f9e0-bc92-4de2-9e00-e3c486409974 could not be found. Aug 30 01:55:32.395233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:32.409165 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0ffe75b2-4f59-4b35-bbfc-205ad7b418cf tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Returning 404 to user: Snapshot 6517f9e0-bc92-4de2-9e00-e3c486409974 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:55:32.410289 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0ffe75b2-4f59-4b35-bbfc-205ad7b418cf tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974" status: 404 len: 111 microversion: 2.1 time: 0.086927 Aug 30 01:55:32.415084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 8/16] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 30 01:55:32 2022] GET /compute/v2.1/os-snapshots/6517f9e0-bc92-4de2-9e00-e3c486409974 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:55:32.420723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6cdae936-0041-4861-8ed2-e6da8896050c tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08f019d0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:32.625307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6cdae936-0041-4861-8ed2-e6da8896050c tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 202 len: 0 microversion: 2.1 time: 0.208650 Aug 30 01:55:32.626111 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 9/17] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 01:55:32 2022] DELETE /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:55:32.635453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e5c57085-894e-4c1b-87dc-ab76e2752e7f tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08dd48b0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:32.746117 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e5c57085-894e-4c1b-87dc-ab76e2752e7f tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.114950 Aug 30 01:55:32.754310 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 9/18] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:32 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:33.485723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2110668969", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71f52012-15ba-448d-9108-20629e1d18ee"}], "security_groups": [{"name": "tempest-securitygroup--106445782"}], "key_name": "tempest-keypair-1795287767", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:33.762674 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f9ac905d-3be6-490b-982a-7f35cd785754 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08dd43a0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:33.858445 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f9ac905d-3be6-490b-982a-7f35cd785754 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.100607 Aug 30 01:55:33.865048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 10/19] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:33 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:34.101658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] validate_networks() for [('71f52012-15ba-448d-9108-20629e1d18ee', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:55:34.872611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2a1d8e5b-04dc-4568-a05c-bbb64c49e923 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08dd4790>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:34.998170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2a1d8e5b-04dc-4568-a05c-bbb64c49e923 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.128743 Aug 30 01:55:34.999187 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 11/20] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:34 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:55:36.012633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-81dcccc3-d7f3-4e33-8b5e-0250773e731f tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08dee1f0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:36.143491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-81dcccc3-d7f3-4e33-8b5e-0250773e731f tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.134569 Aug 30 01:55:36.144335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 12/21] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:36 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:55:36.273202 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9b40614e-5111-475c-9a5b-da0462237c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Action: 'create', calling method: .version_select at 0x7f3b08f26e50>, body: {"keypair": {"name": "tempest-keypair-65531596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9BqKPr+xKYyGTYGloKRSKIdUfqA3D9MQLhYRS1Nvb3MKJbWmUNu1Mgq2U59ZPuezT6vKr+yOYAUTG0zJIlSRgpXe0rhueFn6L+TBSP6Axn4JAN8k16SgUsnRpa3XHjOA=="}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:36.324825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-9b40614e-5111-475c-9a5b-da0462237c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Getting quotas for project 4b0db8e5fc6c48cc98136ef2a85b05f4. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:55:36.347266 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-9b40614e-5111-475c-9a5b-da0462237c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Getting quotas for user 85d2f3d2a8cb40d38d0ca2dc16609ef5 and project 4b0db8e5fc6c48cc98136ef2a85b05f4. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:55:36.404541 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9b40614e-5111-475c-9a5b-da0462237c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.258242 Aug 30 01:55:36.404962 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 13/22] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 01:55:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 260 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 01:55:36.938345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-671356834", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "networks": [{"uuid": "f738c79f-5a05-44a2-ab42-e6cd184ec9f1"}]}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:37.088323 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.network.neutron [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] validate_networks() for [('f738c79f-5a05-44a2-ab42-e6cd184ec9f1', None, None, None, None, None)] {{(pid=120391) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:55:37.572632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:55:37.573141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:55:37.573654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:55:37.574175 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:55:37.574672 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:55:37.614372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:37.614372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:37.614372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:37.614372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:37.615023 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:37.618307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:37.703098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for project b9d96d936ce8417197008a59da394df7. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:55:37.721152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for user a06de37941264b979a3bd5aaf84ec73c and project b9d96d936ce8417197008a59da394df7. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:55:37.749823 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:55:37.765796 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:55:37.972965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-819f465b-7165-4732-ad24-226465011c40 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.491839 Aug 30 01:55:37.975947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 10/23] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:55:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 4495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:55:38.022542 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9db8cbef-ea32-4e0c-8942-f6f677f31020 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b085a6310>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:38.186433 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9db8cbef-ea32-4e0c-8942-f6f677f31020 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.204503 Aug 30 01:55:38.187455 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 11/24] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:37 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:38.194009 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-480186bc-49bc-43ba-a141-b57dbcf88dd1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:38.194834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-480186bc-49bc-43ba-a141-b57dbcf88dd1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:38.625545 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-480186bc-49bc-43ba-a141-b57dbcf88dd1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:38.642964 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-480186bc-49bc-43ba-a141-b57dbcf88dd1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1242 microversion: 2.1 time: 0.453993 Aug 30 01:55:38.658605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 12/25] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:38 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1242 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:38.882805 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dd171ae0-c0b1-4bb8-a469-9c25fcfffc30 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'create', calling method: .version_select at 0x7f3b085bb160>, body: {"keypair": {"name": "tempest-keypair-265171136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHla+Jr4Wug8vUIyjwj8ryOb/SNjlIDujJHwVP4zAoW04PIH2/63ibPshLoIrV8UE7eqN2kvxcLP4rijCcyIwD/+C2FRCPgSRugPdGj20DTJAqUBug2r63MyRW2XkuaIUw=="}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:38.945750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-dd171ae0-c0b1-4bb8-a469-9c25fcfffc30 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Getting quotas for project f90f06a31df841b89ed6874d20340475. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:55:38.956210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-dd171ae0-c0b1-4bb8-a469-9c25fcfffc30 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Getting quotas for user 68fcefa4a0db4bd6a051b1446e1a0d2d and project f90f06a31df841b89ed6874d20340475. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:55:39.038741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dd171ae0-c0b1-4bb8-a469-9c25fcfffc30 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.296084 Aug 30 01:55:39.039425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 13/26] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 01:55:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:55:39.091763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Flavor limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:55:39.092259 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Image limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:55:39.092792 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Flavor pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:55:39.093208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Image pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:55:39.093776 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:55:39.109908 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:39.110407 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:39.110877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:39.111616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:39.112073 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:39.112526 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:39.191689 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Getting quotas for project f4a7212d15b6463f834e8d1cc4ebf685. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:55:39.201909 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e2ee796b-bfc0-492b-831b-b1ce07ed32de tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08555d30>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:39.214081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Getting quotas for user cc7381cfffee4842bee1950a18caf807 and project f4a7212d15b6463f834e8d1cc4ebf685. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:55:39.255381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Going to run 1 instances... {{(pid=120391) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:55:39.258482 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:55:39.329502 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e2ee796b-bfc0-492b-831b-b1ce07ed32de tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.131615 Aug 30 01:55:39.330644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 14/27] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:39 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:55:39.466833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-103464de-1d0f-4bda-9970-0d3b409b9ede tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.649096 Aug 30 01:55:39.468297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 14/28] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:55:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:55:39.490283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-37beea08-81e4-44a3-be8d-24c1b3486fab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:39.491241 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-37beea08-81e4-44a3-be8d-24c1b3486fab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:39.668755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b2058bad-c0cb-4540-8020-f4edad321f8e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:39.669576 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b2058bad-c0cb-4540-8020-f4edad321f8e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:39.681814 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-37beea08-81e4-44a3-be8d-24c1b3486fab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:39.693322 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-37beea08-81e4-44a3-be8d-24c1b3486fab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1214 microversion: 2.1 time: 0.214569 Aug 30 01:55:39.697070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 15/29] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:39 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:39.923967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b2058bad-c0cb-4540-8020-f4edad321f8e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:39.959562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b2058bad-c0cb-4540-8020-f4edad321f8e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1242 microversion: 2.1 time: 0.295434 Aug 30 01:55:39.962694 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 15/30] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:39 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1242 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:40.349339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-da15b272-4823-438d-ba30-c1ef62c7fe7d tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b085554c0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:40.489285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-da15b272-4823-438d-ba30-c1ef62c7fe7d tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.149094 Aug 30 01:55:40.491442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 16/31] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:40 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:40.722415 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-da69deb2-ca62-43ed-912a-cd7ab8956190 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:40.725457 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-da69deb2-ca62-43ed-912a-cd7ab8956190 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:40.866066 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-da69deb2-ca62-43ed-912a-cd7ab8956190 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:40.879002 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-da69deb2-ca62-43ed-912a-cd7ab8956190 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1214 microversion: 2.1 time: 0.160986 Aug 30 01:55:40.879699 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 16/32] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:40 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:40.982598 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cb33e243-86e3-488f-86ef-2ad1b4ed267c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:40.983591 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cb33e243-86e3-488f-86ef-2ad1b4ed267c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:41.002952 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb33e243-86e3-488f-86ef-2ad1b4ed267c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:41.006488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb33e243-86e3-488f-86ef-2ad1b4ed267c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:41.007493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb33e243-86e3-488f-86ef-2ad1b4ed267c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:41.010909 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb33e243-86e3-488f-86ef-2ad1b4ed267c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:41.012841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb33e243-86e3-488f-86ef-2ad1b4ed267c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:41.014285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb33e243-86e3-488f-86ef-2ad1b4ed267c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:41.403755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-229833870", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "129ec4ac-29e2-47fa-a158-5c8fc9447c41"}], "security_groups": [{"name": "tempest-securitygroup--1960717982"}], "key_name": "tempest-keypair-65531596", "user_data": "}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:41.578060 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cb33e243-86e3-488f-86ef-2ad1b4ed267c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:41.594495 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cb33e243-86e3-488f-86ef-2ad1b4ed267c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1294 microversion: 2.1 time: 0.615728 Aug 30 01:55:41.596969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 17/33] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:40 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1294 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:41.602264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9deac1e1-fb5e-48ae-b4c5-c4846cc56d06 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b0857e820>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:41.626009 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.network.neutron [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] validate_networks() for [('129ec4ac-29e2-47fa-a158-5c8fc9447c41', None, None, None, None, None)] {{(pid=120391) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:55:41.694480 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9deac1e1-fb5e-48ae-b4c5-c4846cc56d06 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.095961 Aug 30 01:55:41.695626 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 18/34] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:41 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:41.912125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bb339c9b-e30b-4919-a8e5-59a8be37f5da tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:41.913247 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bb339c9b-e30b-4919-a8e5-59a8be37f5da tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:41.928824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb339c9b-e30b-4919-a8e5-59a8be37f5da tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:41.930442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb339c9b-e30b-4919-a8e5-59a8be37f5da tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:41.933603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb339c9b-e30b-4919-a8e5-59a8be37f5da tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:41.934472 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb339c9b-e30b-4919-a8e5-59a8be37f5da tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:41.936390 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb339c9b-e30b-4919-a8e5-59a8be37f5da tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:41.936935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb339c9b-e30b-4919-a8e5-59a8be37f5da tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:42.200685 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb339c9b-e30b-4919-a8e5-59a8be37f5da tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:42.213290 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bb339c9b-e30b-4919-a8e5-59a8be37f5da tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1218 microversion: 2.1 time: 0.302892 Aug 30 01:55:42.214675 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 19/35] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:41 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1218 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:42.221178 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1260626222", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64655386-6e9d-441e-8ba3-b8d8487789cf"}], "security_groups": [{"name": "tempest-securitygroup--93123339"}], "key_name": "tempest-keypair-265171136", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:42.424635 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] validate_networks() for [('64655386-6e9d-441e-8ba3-b8d8487789cf', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:55:42.445653 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Flavor limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:55:42.446443 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Image limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:55:42.446740 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Flavor pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:55:42.447158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Image pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:55:42.447585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:55:42.462191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:42.463072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:42.463731 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:42.464798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:42.465502 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:42.469100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:42.523946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Getting quotas for project 4b0db8e5fc6c48cc98136ef2a85b05f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:55:42.535146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Getting quotas for user 85d2f3d2a8cb40d38d0ca2dc16609ef5 and project 4b0db8e5fc6c48cc98136ef2a85b05f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:55:42.587430 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Going to run 1 instances... {{(pid=120391) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:55:42.606044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:55:42.739494 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-16144575-7571-4972-9179-50dfd67a6d3a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.341874 Aug 30 01:55:42.740746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 17/36] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 01:55:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 01:55:42.761896 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1296319c-922f-4911-af3f-dbfc67ae7d47 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:42.764726 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1296319c-922f-4911-af3f-dbfc67ae7d47 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:42.784654 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1296319c-922f-4911-af3f-dbfc67ae7d47 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:42.790292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1296319c-922f-4911-af3f-dbfc67ae7d47 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:42.792405 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1296319c-922f-4911-af3f-dbfc67ae7d47 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:42.795881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1296319c-922f-4911-af3f-dbfc67ae7d47 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:42.796718 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1296319c-922f-4911-af3f-dbfc67ae7d47 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:42.798620 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1296319c-922f-4911-af3f-dbfc67ae7d47 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:43.419070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:55:43.419646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1296319c-922f-4911-af3f-dbfc67ae7d47 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:43.420222 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:55:43.420881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:55:43.421437 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:55:43.421998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:55:43.433107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:43.433894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:43.434816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:43.435762 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:43.436469 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:43.437119 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:43.441603 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1296319c-922f-4911-af3f-dbfc67ae7d47 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1294 microversion: 2.1 time: 0.699597 Aug 30 01:55:43.442197 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 18/37] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:42 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1294 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:43.453296 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e22e0169-70d2-405c-9b31-266c34e1c458 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b08449820>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:43.485960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Getting quotas for project f90f06a31df841b89ed6874d20340475. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:55:43.490427 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Getting quotas for user 68fcefa4a0db4bd6a051b1446e1a0d2d and project f90f06a31df841b89ed6874d20340475. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:55:43.519432 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:55:43.521637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:55:43.530524 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e22e0169-70d2-405c-9b31-266c34e1c458 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.084306 Aug 30 01:55:43.532377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 19/38] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:43 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:43.542428 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-63c029d7-dec3-4cb7-a58f-1a9aed0bcbfd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:43.543557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-63c029d7-dec3-4cb7-a58f-1a9aed0bcbfd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:43.612048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-63c029d7-dec3-4cb7-a58f-1a9aed0bcbfd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:43.623434 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-63c029d7-dec3-4cb7-a58f-1a9aed0bcbfd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:43.627386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-63c029d7-dec3-4cb7-a58f-1a9aed0bcbfd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:43.628803 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-63c029d7-dec3-4cb7-a58f-1a9aed0bcbfd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1279 microversion: 2.20 time: 0.094497 Aug 30 01:55:43.630152 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 20/39] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:43 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:43.630506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-070fc711-3c80-4a20-b67f-40a3c840033b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.414508 Aug 30 01:55:43.635640 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-72f826be-a636-4ddb-b943-9ac29b093620 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:43.636427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-72f826be-a636-4ddb-b943-9ac29b093620 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:43.637822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 20/40] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:55:42 2022] POST /compute/v2.1/servers => generated 400 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:55:43.644290 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-292a6631-a777-4257-924e-9b868af051e5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:43.646226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-292a6631-a777-4257-924e-9b868af051e5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:43.650294 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72f826be-a636-4ddb-b943-9ac29b093620 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:43.651070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72f826be-a636-4ddb-b943-9ac29b093620 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:43.651716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72f826be-a636-4ddb-b943-9ac29b093620 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:43.652714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72f826be-a636-4ddb-b943-9ac29b093620 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:43.653384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72f826be-a636-4ddb-b943-9ac29b093620 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:43.654014 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72f826be-a636-4ddb-b943-9ac29b093620 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:43.749122 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-292a6631-a777-4257-924e-9b868af051e5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:43.759032 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-292a6631-a777-4257-924e-9b868af051e5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1237 microversion: 2.1 time: 0.120089 Aug 30 01:55:43.769439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 21/41] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:43 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:43.781152 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-72f826be-a636-4ddb-b943-9ac29b093620 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:43.791380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-72f826be-a636-4ddb-b943-9ac29b093620 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1218 microversion: 2.1 time: 0.159006 Aug 30 01:55:43.792039 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 21/42] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:43 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:44.463813 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d7ca67f4-aed4-4bc4-8312-9deb83883fca tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:44.465355 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d7ca67f4-aed4-4bc4-8312-9deb83883fca tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:44.472839 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7ca67f4-aed4-4bc4-8312-9deb83883fca tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:44.473646 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7ca67f4-aed4-4bc4-8312-9deb83883fca tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:44.474290 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7ca67f4-aed4-4bc4-8312-9deb83883fca tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:44.475270 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7ca67f4-aed4-4bc4-8312-9deb83883fca tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:44.475931 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7ca67f4-aed4-4bc4-8312-9deb83883fca tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:44.476741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7ca67f4-aed4-4bc4-8312-9deb83883fca tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:44.543072 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d7ca67f4-aed4-4bc4-8312-9deb83883fca tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:44.546024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-39a9eca5-3c72-4ab9-ae2a-d5e3c8123795 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b0847f0d0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:44.551543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d7ca67f4-aed4-4bc4-8312-9deb83883fca tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1294 microversion: 2.1 time: 0.092384 Aug 30 01:55:44.552277 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 22/43] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:44 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:44.597551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-39a9eca5-3c72-4ab9-ae2a-d5e3c8123795 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.056747 Aug 30 01:55:44.598371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 22/44] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:44 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:55:44.652064 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:44.652696 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:44.659185 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:44.659666 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:44.660136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:44.660850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:44.661308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:44.661733 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:44.721706 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:44.729602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:44.730996 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:44.732084 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7aa27a18-0fe1-478f-b7fb-39090dd59aaa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1283 microversion: 2.20 time: 0.083909 Aug 30 01:55:44.732663 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 23/45] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:44 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1283 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:44.779799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-96ab786d-ca15-466e-92e0-9bbbad94e986 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:44.780439 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-96ab786d-ca15-466e-92e0-9bbbad94e986 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:44.786371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96ab786d-ca15-466e-92e0-9bbbad94e986 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:44.786856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96ab786d-ca15-466e-92e0-9bbbad94e986 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:44.787296 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96ab786d-ca15-466e-92e0-9bbbad94e986 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:44.787989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96ab786d-ca15-466e-92e0-9bbbad94e986 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:44.788471 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96ab786d-ca15-466e-92e0-9bbbad94e986 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:44.788897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96ab786d-ca15-466e-92e0-9bbbad94e986 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:44.813690 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c50bbade-5ae9-4e39-b6e5-383e744c7e36 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:44.815165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c50bbade-5ae9-4e39-b6e5-383e744c7e36 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:44.822136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50bbade-5ae9-4e39-b6e5-383e744c7e36 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:44.822886 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50bbade-5ae9-4e39-b6e5-383e744c7e36 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:44.823323 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50bbade-5ae9-4e39-b6e5-383e744c7e36 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:44.824189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50bbade-5ae9-4e39-b6e5-383e744c7e36 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:44.824818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50bbade-5ae9-4e39-b6e5-383e744c7e36 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:44.825270 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50bbade-5ae9-4e39-b6e5-383e744c7e36 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:44.856645 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-96ab786d-ca15-466e-92e0-9bbbad94e986 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:44.864473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-96ab786d-ca15-466e-92e0-9bbbad94e986 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1241 microversion: 2.1 time: 0.088455 Aug 30 01:55:44.865720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 23/46] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:44 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:44.889408 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c50bbade-5ae9-4e39-b6e5-383e744c7e36 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:44.898086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c50bbade-5ae9-4e39-b6e5-383e744c7e36 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1218 microversion: 2.1 time: 0.088163 Aug 30 01:55:44.898649 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 24/47] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:44 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:45.572079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c161bd42-6099-48e3-b0a5-c6f9e81c2543 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:45.572643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c161bd42-6099-48e3-b0a5-c6f9e81c2543 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:45.579555 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c161bd42-6099-48e3-b0a5-c6f9e81c2543 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:45.580044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c161bd42-6099-48e3-b0a5-c6f9e81c2543 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:45.580510 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c161bd42-6099-48e3-b0a5-c6f9e81c2543 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:45.581185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c161bd42-6099-48e3-b0a5-c6f9e81c2543 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:45.581636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c161bd42-6099-48e3-b0a5-c6f9e81c2543 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:45.582056 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c161bd42-6099-48e3-b0a5-c6f9e81c2543 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:45.611816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3ab7a0b8-71b6-47c3-8f76-61e66e4eb34a tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b0857ec10>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:45.693999 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c161bd42-6099-48e3-b0a5-c6f9e81c2543 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:45.733184 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c161bd42-6099-48e3-b0a5-c6f9e81c2543 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1294 microversion: 2.1 time: 0.163975 Aug 30 01:55:45.735027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 24/48] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:45 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1294 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:45.749864 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3ab7a0b8-71b6-47c3-8f76-61e66e4eb34a tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 200 len: 344 microversion: 2.1 time: 0.142626 Aug 30 01:55:45.755009 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:45.756111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:45.756921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 25/49] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:45 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 344 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:45.763451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:45.764441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:45.765470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:45.766612 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:45.767851 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:45.768479 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:45.841750 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:45.852493 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:45.854573 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:45.856397 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2c7e99c3-3ad7-410d-bf07-536211f59a68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1275 microversion: 2.20 time: 0.106162 Aug 30 01:55:45.857585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 25/50] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:45 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1275 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:55:45.886609 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-79ff5680-6ce4-4ce6-be99-53c77f019d04 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:45.887249 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-79ff5680-6ce4-4ce6-be99-53c77f019d04 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:45.893978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79ff5680-6ce4-4ce6-be99-53c77f019d04 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:45.894466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79ff5680-6ce4-4ce6-be99-53c77f019d04 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:45.894905 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79ff5680-6ce4-4ce6-be99-53c77f019d04 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:45.895599 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79ff5680-6ce4-4ce6-be99-53c77f019d04 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:45.896056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79ff5680-6ce4-4ce6-be99-53c77f019d04 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:45.896515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-79ff5680-6ce4-4ce6-be99-53c77f019d04 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:45.919258 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c90c0b63-3369-4a7a-9f9d-9c53973f051c tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:45.919821 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c90c0b63-3369-4a7a-9f9d-9c53973f051c tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:45.925855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c90c0b63-3369-4a7a-9f9d-9c53973f051c tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:45.926338 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c90c0b63-3369-4a7a-9f9d-9c53973f051c tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:45.926777 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c90c0b63-3369-4a7a-9f9d-9c53973f051c tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:45.927496 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c90c0b63-3369-4a7a-9f9d-9c53973f051c tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:45.927952 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c90c0b63-3369-4a7a-9f9d-9c53973f051c tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:45.928425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c90c0b63-3369-4a7a-9f9d-9c53973f051c tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:45.959675 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-79ff5680-6ce4-4ce6-be99-53c77f019d04 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:45.969218 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-79ff5680-6ce4-4ce6-be99-53c77f019d04 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1233 microversion: 2.1 time: 0.086779 Aug 30 01:55:45.970093 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 26/51] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:45 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:45.993556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c90c0b63-3369-4a7a-9f9d-9c53973f051c tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:46.007509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c90c0b63-3369-4a7a-9f9d-9c53973f051c tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1266 microversion: 2.1 time: 0.092268 Aug 30 01:55:46.008315 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 26/52] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:45 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:46.755798 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d1eb9d05-1de7-48d8-b872-4ca224d43c34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:46.756426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d1eb9d05-1de7-48d8-b872-4ca224d43c34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:46.764066 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1eb9d05-1de7-48d8-b872-4ca224d43c34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:46.764593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1eb9d05-1de7-48d8-b872-4ca224d43c34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:46.765028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1eb9d05-1de7-48d8-b872-4ca224d43c34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:46.765720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1eb9d05-1de7-48d8-b872-4ca224d43c34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:46.765941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-671b2ce2-1c45-4992-846d-9547645ec71a tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b0847f5e0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:46.766379 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1eb9d05-1de7-48d8-b872-4ca224d43c34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:46.766741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1eb9d05-1de7-48d8-b872-4ca224d43c34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:46.794938 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-671b2ce2-1c45-4992-846d-9547645ec71a tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] HTTP exception thrown: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-671b2ce2-1c45-4992-846d-9547645ec71a tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Request method failure captured: Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d HTTP/1.1 Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4GTbp5L6KoPobu7SVGyIWBcPFahbqby9U-9GPYjMI-dOdCr4_u_--WIYPNPKLg8HyjZQayr3IcWXd3GEBz--qCHD2PaRCKY014G6t9xsK3IWGyJhPRaDetl2RaMhiZJoiHkusgXq0PIi_d3aeFDhv9Uo4W_PgyJDNtC4RUQ__HUCU Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 56a61719b5c8402b9542dacad4242644 Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 01:55:46.797787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a61719b5c8402b9542dacad4242644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a61719b5c8402b9542dacad4242644"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/56a61719b5c8402b9542dacad4242644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_56a61719b5c8402b9542dacad4242644"}]}] Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 56a61719b5c8402b9542dacad4242644 Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-VolumesSnapshotsTestJSON-1298583182-project Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: b74a7caa5628414bbbf9bab161625f0d Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298583182-project Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '888a6803-e37e-4569-87b3-ee5363a1654d'} Aug 30 01:55:46.799433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. (HTTP 404) (Request-ID: req-ca62f66c-ce4d-4c63-8168-d12aba28af89) Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:46.800700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:55:46.801646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:55:46.802528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.803525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.807670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-671b2ce2-1c45-4992-846d-9547645ec71a tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Returning 404 to user: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:55:46.809515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-671b2ce2-1c45-4992-846d-9547645ec71a tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 404 len: 109 microversion: 2.1 time: 0.049301 Aug 30 01:55:46.811376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 27/53] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:46 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:55:46.825411 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f5e97545-1707-4203-a34d-dd74542cac7e tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b0847f430>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:46.848749 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d1eb9d05-1de7-48d8-b872-4ca224d43c34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:46.858430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d1eb9d05-1de7-48d8-b872-4ca224d43c34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1300 microversion: 2.1 time: 0.106765 Aug 30 01:55:46.859027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 27/54] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:46 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:46.876198 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-f5e97545-1707-4203-a34d-dd74542cac7e tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] HTTP exception thrown: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f5e97545-1707-4203-a34d-dd74542cac7e tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Request method failure captured: Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: DELETE /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d HTTP/1.1 Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4GTbp5L6KoPobu7SVGyIWBcPFahbqby9U-9GPYjMI-dOdCr4_u_--WIYPNPKLg8HyjZQayr3IcWXd3GEBz--qCHD2PaRCKY014G6t9xsK3IWGyJhPRaDetl2RaMhiZJoiHkusgXq0PIi_d3aeFDhv9Uo4W_PgyJDNtC4RUQ__HUCU Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 56a61719b5c8402b9542dacad4242644 Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 01:55:46.879101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a61719b5c8402b9542dacad4242644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a61719b5c8402b9542dacad4242644"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/56a61719b5c8402b9542dacad4242644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_56a61719b5c8402b9542dacad4242644"}]}] Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 56a61719b5c8402b9542dacad4242644 Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-VolumesSnapshotsTestJSON-1298583182-project Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: b74a7caa5628414bbbf9bab161625f0d Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298583182-project Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '888a6803-e37e-4569-87b3-ee5363a1654d'} Aug 30 01:55:46.880320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. (HTTP 404) (Request-ID: req-281f7235-0075-460d-b240-f4c50fbe899f) Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:46.881188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:55:46.882370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 01:55:46.886714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f5e97545-1707-4203-a34d-dd74542cac7e tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Returning 404 to user: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f5e97545-1707-4203-a34d-dd74542cac7e tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 404 len: 109 microversion: 2.1 time: 0.060298 Aug 30 01:55:46.888882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 28/55] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 01:55:46 2022] DELETE /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:55:46.892683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:46.893482 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:46.899953 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:46.901009 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:46.901514 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5e7ec065-ce23-4c35-862a-2e7814fb4ad6 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Calling method '.version_select at 0x7f3b0847fee0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:46.902875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:46.903801 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:46.904511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:46.904949 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:46.944450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-5e7ec065-ce23-4c35-862a-2e7814fb4ad6 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] HTTP exception thrown: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5e7ec065-ce23-4c35-862a-2e7814fb4ad6 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Request method failure captured: Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d HTTP/1.1 Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4GTbp5L6KoPobu7SVGyIWBcPFahbqby9U-9GPYjMI-dOdCr4_u_--WIYPNPKLg8HyjZQayr3IcWXd3GEBz--qCHD2PaRCKY014G6t9xsK3IWGyJhPRaDetl2RaMhiZJoiHkusgXq0PIi_d3aeFDhv9Uo4W_PgyJDNtC4RUQ__HUCU Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 56a61719b5c8402b9542dacad4242644 Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 01:55:46.946427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a61719b5c8402b9542dacad4242644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/56a61719b5c8402b9542dacad4242644"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/56a61719b5c8402b9542dacad4242644"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_56a61719b5c8402b9542dacad4242644"}]}] Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 56a61719b5c8402b9542dacad4242644 Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1298583182 Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-VolumesSnapshotsTestJSON-1298583182-project Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: b74a7caa5628414bbbf9bab161625f0d Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1298583182-project Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '888a6803-e37e-4569-87b3-ee5363a1654d'} Aug 30 01:55:46.947586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. (HTTP 404) (Request-ID: req-76944684-007c-4d6b-8de8-30de1a13fc9c) Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:46.948208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:55:46.950919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:55:46.953019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5e7ec065-ce23-4c35-862a-2e7814fb4ad6 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] Returning 404 to user: Volume 888a6803-e37e-4569-87b3-ee5363a1654d could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5e7ec065-ce23-4c35-862a-2e7814fb4ad6 tempest-VolumesSnapshotsTestJSON-1298583182 tempest-VolumesSnapshotsTestJSON-1298583182-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d" status: 404 len: 109 microversion: 2.1 time: 0.058536 Aug 30 01:55:46.955604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 29/56] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 01:55:46 2022] GET /compute/v2.1/os-volumes/888a6803-e37e-4569-87b3-ee5363a1654d => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:55:46.995922 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c03295bb-8403-41e4-98ce-3938fa9389ba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:47.009833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c03295bb-8403-41e4-98ce-3938fa9389ba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:47.014815 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:47.025262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:47.026843 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:47.027843 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-758c0327-3cd4-42b7-8350-3ddeb55a7d28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1331 microversion: 2.20 time: 0.152844 Aug 30 01:55:47.034899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c03295bb-8403-41e4-98ce-3938fa9389ba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:47.035305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c03295bb-8403-41e4-98ce-3938fa9389ba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:47.035744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c03295bb-8403-41e4-98ce-3938fa9389ba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:47.037018 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 28/57] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:46 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:55:47.039059 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c03295bb-8403-41e4-98ce-3938fa9389ba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:47.039573 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c03295bb-8403-41e4-98ce-3938fa9389ba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:47.040015 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c03295bb-8403-41e4-98ce-3938fa9389ba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:47.049419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5029a778-407e-48ed-942c-15c7bcb1b28f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:47.050733 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5029a778-407e-48ed-942c-15c7bcb1b28f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:47.057440 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5029a778-407e-48ed-942c-15c7bcb1b28f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:47.057943 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5029a778-407e-48ed-942c-15c7bcb1b28f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:47.058459 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5029a778-407e-48ed-942c-15c7bcb1b28f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:47.059429 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5029a778-407e-48ed-942c-15c7bcb1b28f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:47.059967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5029a778-407e-48ed-942c-15c7bcb1b28f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:47.060594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5029a778-407e-48ed-942c-15c7bcb1b28f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:47.148211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c03295bb-8403-41e4-98ce-3938fa9389ba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:47.157134 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c03295bb-8403-41e4-98ce-3938fa9389ba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1289 microversion: 2.1 time: 0.168710 Aug 30 01:55:47.158921 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 30/58] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:46 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1289 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:47.241934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5029a778-407e-48ed-942c-15c7bcb1b28f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:47.251254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5029a778-407e-48ed-942c-15c7bcb1b28f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1266 microversion: 2.1 time: 0.209550 Aug 30 01:55:47.264183 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 29/59] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:47 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:47.883038 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8f67bfc0-ac60-40bf-9756-6052a38d7fe3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:47.884293 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8f67bfc0-ac60-40bf-9756-6052a38d7fe3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:47.896278 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f67bfc0-ac60-40bf-9756-6052a38d7fe3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:47.905288 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f67bfc0-ac60-40bf-9756-6052a38d7fe3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:47.905756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f67bfc0-ac60-40bf-9756-6052a38d7fe3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:47.916362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f67bfc0-ac60-40bf-9756-6052a38d7fe3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:47.920895 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f67bfc0-ac60-40bf-9756-6052a38d7fe3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:47.922794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f67bfc0-ac60-40bf-9756-6052a38d7fe3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:48.060301 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:48.062337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:48.078469 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:48.079165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:48.079848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:48.080736 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:48.081340 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:48.085961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:48.202405 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8f67bfc0-ac60-40bf-9756-6052a38d7fe3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:48.219427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8f67bfc0-ac60-40bf-9756-6052a38d7fe3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1300 microversion: 2.1 time: 0.338253 Aug 30 01:55:48.222444 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 31/60] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:47 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1300 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:48.248376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-85e6f4b4-0ffc-41a0-8e0d-810f4e0082e6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:48.249020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-85e6f4b4-0ffc-41a0-8e0d-810f4e0082e6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:48.276402 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85e6f4b4-0ffc-41a0-8e0d-810f4e0082e6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:48.281764 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85e6f4b4-0ffc-41a0-8e0d-810f4e0082e6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:48.284754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85e6f4b4-0ffc-41a0-8e0d-810f4e0082e6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:48.288961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85e6f4b4-0ffc-41a0-8e0d-810f4e0082e6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:48.294101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85e6f4b4-0ffc-41a0-8e0d-810f4e0082e6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:48.295204 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85e6f4b4-0ffc-41a0-8e0d-810f4e0082e6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:48.376224 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:48.398538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:48.411588 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:48.417273 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e689e18a-9033-4a51-a05f-57129ad52183 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1331 microversion: 2.20 time: 0.361479 Aug 30 01:55:48.421487 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 30/61] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:48 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1331 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:48.453133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fa3b1d77-a15e-40ed-92f3-73bcc6a5bb39 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:48.455980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fa3b1d77-a15e-40ed-92f3-73bcc6a5bb39 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:48.499048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa3b1d77-a15e-40ed-92f3-73bcc6a5bb39 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:48.499637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa3b1d77-a15e-40ed-92f3-73bcc6a5bb39 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:48.506143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa3b1d77-a15e-40ed-92f3-73bcc6a5bb39 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:48.506910 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa3b1d77-a15e-40ed-92f3-73bcc6a5bb39 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:48.517764 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa3b1d77-a15e-40ed-92f3-73bcc6a5bb39 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:48.520565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa3b1d77-a15e-40ed-92f3-73bcc6a5bb39 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:48.523760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-85e6f4b4-0ffc-41a0-8e0d-810f4e0082e6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:48.556151 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-85e6f4b4-0ffc-41a0-8e0d-810f4e0082e6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1289 microversion: 2.1 time: 0.310064 Aug 30 01:55:48.572260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 32/62] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:48 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1289 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:49.056705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fa3b1d77-a15e-40ed-92f3-73bcc6a5bb39 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:49.071182 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fa3b1d77-a15e-40ed-92f3-73bcc6a5bb39 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1274 microversion: 2.1 time: 0.637547 Aug 30 01:55:49.077126 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 31/63] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:48 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1274 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:49.254801 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-dbb24cb6-1187-42b0-9f9d-c34f727eab6a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:49.256693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-dbb24cb6-1187-42b0-9f9d-c34f727eab6a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:49.276418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbb24cb6-1187-42b0-9f9d-c34f727eab6a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:49.277330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbb24cb6-1187-42b0-9f9d-c34f727eab6a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:49.277863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbb24cb6-1187-42b0-9f9d-c34f727eab6a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:49.280688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbb24cb6-1187-42b0-9f9d-c34f727eab6a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:49.281363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbb24cb6-1187-42b0-9f9d-c34f727eab6a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:49.282006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbb24cb6-1187-42b0-9f9d-c34f727eab6a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:49.445181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:49.445955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:49.458932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:49.463701 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:49.464501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:49.472305 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:49.473416 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:49.473902 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:49.602629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:49.617345 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:49.619702 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:49.622381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9152f857-49f7-488b-b45f-6598b0bc2721 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1349 microversion: 2.20 time: 0.181133 Aug 30 01:55:49.623702 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 32/64] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:49 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1349 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:55:49.635575 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a201d4f1-7813-417e-99fd-718675c2ec98 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:49.636612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a201d4f1-7813-417e-99fd-718675c2ec98 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:49.643735 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a201d4f1-7813-417e-99fd-718675c2ec98 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:49.644545 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a201d4f1-7813-417e-99fd-718675c2ec98 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:49.645201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a201d4f1-7813-417e-99fd-718675c2ec98 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:49.647066 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a201d4f1-7813-417e-99fd-718675c2ec98 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:49.647710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a201d4f1-7813-417e-99fd-718675c2ec98 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:49.648364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a201d4f1-7813-417e-99fd-718675c2ec98 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:49.775924 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-dbb24cb6-1187-42b0-9f9d-c34f727eab6a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:49.782960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a201d4f1-7813-417e-99fd-718675c2ec98 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:49.785483 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-dbb24cb6-1187-42b0-9f9d-c34f727eab6a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.536089 Aug 30 01:55:49.800400 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a201d4f1-7813-417e-99fd-718675c2ec98 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.175127 Aug 30 01:55:49.800839 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 33/65] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:49 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:49.819097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 33/66] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:49 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:50.102439 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e43f374c-0961-48c1-b27b-81b333b2e01d tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:50.103358 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e43f374c-0961-48c1-b27b-81b333b2e01d tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:50.110846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e43f374c-0961-48c1-b27b-81b333b2e01d tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:50.112075 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e43f374c-0961-48c1-b27b-81b333b2e01d tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:50.112760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e43f374c-0961-48c1-b27b-81b333b2e01d tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:50.113609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e43f374c-0961-48c1-b27b-81b333b2e01d tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:50.114200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e43f374c-0961-48c1-b27b-81b333b2e01d tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:50.114759 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e43f374c-0961-48c1-b27b-81b333b2e01d tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:50.204366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e43f374c-0961-48c1-b27b-81b333b2e01d tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:50.213274 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e43f374c-0961-48c1-b27b-81b333b2e01d tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1272 microversion: 2.1 time: 0.115850 Aug 30 01:55:50.215101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 34/67] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:50 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:50.651070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:50.651674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:50.659312 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:50.660213 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:50.660884 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:50.661680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:50.662197 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:50.662775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:50.759258 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:50.770585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:50.772018 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:50.773151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-137bb217-5573-4ba3-9fdd-81c3694ae62b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1349 microversion: 2.20 time: 0.125975 Aug 30 01:55:50.784339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 34/68] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:50 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1349 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:50.808288 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cab5e0cf-43bd-469c-9cbc-d7b9bc82301d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:50.808785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cab5e0cf-43bd-469c-9cbc-d7b9bc82301d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:50.815270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cab5e0cf-43bd-469c-9cbc-d7b9bc82301d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:50.815751 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cab5e0cf-43bd-469c-9cbc-d7b9bc82301d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:50.816179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cab5e0cf-43bd-469c-9cbc-d7b9bc82301d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:50.816900 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cab5e0cf-43bd-469c-9cbc-d7b9bc82301d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:50.817350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cab5e0cf-43bd-469c-9cbc-d7b9bc82301d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:50.817769 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cab5e0cf-43bd-469c-9cbc-d7b9bc82301d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:50.836716 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5442efa0-a6cb-46bc-a596-cd2ef1dcf85b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:50.837987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5442efa0-a6cb-46bc-a596-cd2ef1dcf85b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:50.848645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5442efa0-a6cb-46bc-a596-cd2ef1dcf85b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:50.850247 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5442efa0-a6cb-46bc-a596-cd2ef1dcf85b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:50.850247 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5442efa0-a6cb-46bc-a596-cd2ef1dcf85b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:50.851260 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5442efa0-a6cb-46bc-a596-cd2ef1dcf85b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:50.851996 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5442efa0-a6cb-46bc-a596-cd2ef1dcf85b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:50.852621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5442efa0-a6cb-46bc-a596-cd2ef1dcf85b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:50.977934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5442efa0-a6cb-46bc-a596-cd2ef1dcf85b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:50.992422 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5442efa0-a6cb-46bc-a596-cd2ef1dcf85b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.170147 Aug 30 01:55:51.004470 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 35/69] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:50 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:51.120639 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cab5e0cf-43bd-469c-9cbc-d7b9bc82301d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:51.134700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cab5e0cf-43bd-469c-9cbc-d7b9bc82301d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.330537 Aug 30 01:55:51.135937 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 35/70] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:50 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:51.236873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cf8a893-317a-4f67-9dbb-a2398605ec5a tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:51.237528 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7cf8a893-317a-4f67-9dbb-a2398605ec5a tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:51.245520 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf8a893-317a-4f67-9dbb-a2398605ec5a tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:51.245999 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf8a893-317a-4f67-9dbb-a2398605ec5a tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:51.247415 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf8a893-317a-4f67-9dbb-a2398605ec5a tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:51.248284 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf8a893-317a-4f67-9dbb-a2398605ec5a tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:51.249008 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf8a893-317a-4f67-9dbb-a2398605ec5a tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:51.249619 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf8a893-317a-4f67-9dbb-a2398605ec5a tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:51.347550 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7cf8a893-317a-4f67-9dbb-a2398605ec5a tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:51.351527 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:51.357234 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7cf8a893-317a-4f67-9dbb-a2398605ec5a tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1272 microversion: 2.1 time: 0.124931 Aug 30 01:55:51.358117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 36/71] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:51 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:51.797565 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:51.798171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:51.800813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:51.807040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:51.808307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:51.809092 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:51.810382 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:51.815993 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:51.816658 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:51.895178 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:51.905276 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:51.906789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:51.908381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e9b6cf1c-5581-4579-ac01-dc2651fee78f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1349 microversion: 2.20 time: 0.114557 Aug 30 01:55:51.909005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 36/72] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:51 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1349 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:52.023769 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b5bc481c-fda3-4fc9-99d3-8a51e1508739 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:52.024423 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b5bc481c-fda3-4fc9-99d3-8a51e1508739 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:52.050094 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5bc481c-fda3-4fc9-99d3-8a51e1508739 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:52.050890 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5bc481c-fda3-4fc9-99d3-8a51e1508739 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:52.051330 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5bc481c-fda3-4fc9-99d3-8a51e1508739 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:52.052028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5bc481c-fda3-4fc9-99d3-8a51e1508739 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:52.052932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5bc481c-fda3-4fc9-99d3-8a51e1508739 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:52.053497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b5bc481c-fda3-4fc9-99d3-8a51e1508739 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:52.155389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-462ff57f-e40b-4045-8910-51875f0e8f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:52.156007 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-462ff57f-e40b-4045-8910-51875f0e8f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:52.177167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-462ff57f-e40b-4045-8910-51875f0e8f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:52.177649 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-462ff57f-e40b-4045-8910-51875f0e8f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:52.178080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-462ff57f-e40b-4045-8910-51875f0e8f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:52.178800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-462ff57f-e40b-4045-8910-51875f0e8f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:52.179250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-462ff57f-e40b-4045-8910-51875f0e8f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:52.179672 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-462ff57f-e40b-4045-8910-51875f0e8f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:52.223783 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b5bc481c-fda3-4fc9-99d3-8a51e1508739 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:52.237993 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b5bc481c-fda3-4fc9-99d3-8a51e1508739 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.222316 Aug 30 01:55:52.255409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 37/73] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:52 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:52.383392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4681aeaf-5a32-4685-870b-91c1155c427e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:52.384007 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4681aeaf-5a32-4685-870b-91c1155c427e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:52.401129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4681aeaf-5a32-4685-870b-91c1155c427e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:52.401623 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4681aeaf-5a32-4685-870b-91c1155c427e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:52.402056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4681aeaf-5a32-4685-870b-91c1155c427e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:52.402754 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4681aeaf-5a32-4685-870b-91c1155c427e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:52.405246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4681aeaf-5a32-4685-870b-91c1155c427e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:52.405690 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4681aeaf-5a32-4685-870b-91c1155c427e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:52.487762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=4 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:52.499471 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-462ff57f-e40b-4045-8910-51875f0e8f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:52.518273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-462ff57f-e40b-4045-8910-51875f0e8f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.366994 Aug 30 01:55:52.532479 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 37/74] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:52 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:52.533502 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4681aeaf-5a32-4685-870b-91c1155c427e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:52.543338 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4681aeaf-5a32-4685-870b-91c1155c427e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1272 microversion: 2.1 time: 0.168048 Aug 30 01:55:52.545043 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 38/75] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:52 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:52.930643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:52.931319 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:52.937992 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:52.938465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:52.939407 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:52.940107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:52.940582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:52.941247 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:53.002783 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:53.010764 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:53.012211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:53.013328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b91888ae-fbca-4432-8232-579f164e057a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1349 microversion: 2.20 time: 0.086594 Aug 30 01:55:53.013880 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 38/76] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:52 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:53.262917 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9ab21467-249d-4081-9dd3-0f59c8b7b97f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:53.263523 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9ab21467-249d-4081-9dd3-0f59c8b7b97f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:53.270257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ab21467-249d-4081-9dd3-0f59c8b7b97f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:53.270871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ab21467-249d-4081-9dd3-0f59c8b7b97f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:53.271421 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ab21467-249d-4081-9dd3-0f59c8b7b97f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:53.272181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ab21467-249d-4081-9dd3-0f59c8b7b97f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:53.272728 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ab21467-249d-4081-9dd3-0f59c8b7b97f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:53.273150 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ab21467-249d-4081-9dd3-0f59c8b7b97f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:53.336605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9ab21467-249d-4081-9dd3-0f59c8b7b97f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:53.344316 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9ab21467-249d-4081-9dd3-0f59c8b7b97f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.085224 Aug 30 01:55:53.344945 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 39/77] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:53 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:53.541862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d446887e-a683-4b38-9d0b-8ecf48687c7e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:53.542465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d446887e-a683-4b38-9d0b-8ecf48687c7e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:53.548848 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d446887e-a683-4b38-9d0b-8ecf48687c7e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:53.549327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d446887e-a683-4b38-9d0b-8ecf48687c7e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:53.549751 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d446887e-a683-4b38-9d0b-8ecf48687c7e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:53.550423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d446887e-a683-4b38-9d0b-8ecf48687c7e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:53.550869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d446887e-a683-4b38-9d0b-8ecf48687c7e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:53.551283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d446887e-a683-4b38-9d0b-8ecf48687c7e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:53.565385 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2944dfce-041c-485d-aa27-42387e499515 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:53.565991 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2944dfce-041c-485d-aa27-42387e499515 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:53.567797 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:53.569907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:53.581399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2944dfce-041c-485d-aa27-42387e499515 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:53.581983 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2944dfce-041c-485d-aa27-42387e499515 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:53.582509 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2944dfce-041c-485d-aa27-42387e499515 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:53.583645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2944dfce-041c-485d-aa27-42387e499515 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:53.584499 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2944dfce-041c-485d-aa27-42387e499515 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:53.585153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2944dfce-041c-485d-aa27-42387e499515 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:53.620715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=26 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:53.658962 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2944dfce-041c-485d-aa27-42387e499515 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:53.667942 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2944dfce-041c-485d-aa27-42387e499515 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1272 microversion: 2.1 time: 0.106622 Aug 30 01:55:53.668604 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 40/78] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:53 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:53.732410 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d446887e-a683-4b38-9d0b-8ecf48687c7e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:53.735763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:53.744185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d446887e-a683-4b38-9d0b-8ecf48687c7e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.206096 Aug 30 01:55:53.744767 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 39/79] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:53 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:54.036644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:54.037252 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:54.039081 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=22 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:54.044630 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:54.045112 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:54.045548 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:54.046235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:54.046686 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:54.047113 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:54.109033 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:54.118056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:54.119482 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:54.120596 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5df9fd08-7f59-4d2e-8a1c-b1ec017f1b7a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1349 microversion: 2.20 time: 0.088557 Aug 30 01:55:54.121139 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 41/80] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:54 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:54.364929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c33ed7e9-784d-4702-ace9-97e624774e68 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:54.365529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c33ed7e9-784d-4702-ace9-97e624774e68 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:54.371505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c33ed7e9-784d-4702-ace9-97e624774e68 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:54.371983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c33ed7e9-784d-4702-ace9-97e624774e68 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:54.372457 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c33ed7e9-784d-4702-ace9-97e624774e68 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:54.373138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c33ed7e9-784d-4702-ace9-97e624774e68 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:54.373582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c33ed7e9-784d-4702-ace9-97e624774e68 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:54.373996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c33ed7e9-784d-4702-ace9-97e624774e68 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:54.436834 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c33ed7e9-784d-4702-ace9-97e624774e68 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:54.444763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c33ed7e9-784d-4702-ace9-97e624774e68 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.083633 Aug 30 01:55:54.445316 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 40/81] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:54 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:54.689920 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a5e120fa-a407-4dfb-b951-f2582bda5b69 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:54.690522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a5e120fa-a407-4dfb-b951-f2582bda5b69 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:54.696426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5e120fa-a407-4dfb-b951-f2582bda5b69 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:54.696897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5e120fa-a407-4dfb-b951-f2582bda5b69 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:54.697324 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5e120fa-a407-4dfb-b951-f2582bda5b69 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:54.697996 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5e120fa-a407-4dfb-b951-f2582bda5b69 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:54.698438 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5e120fa-a407-4dfb-b951-f2582bda5b69 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:54.698852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5e120fa-a407-4dfb-b951-f2582bda5b69 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:54.759159 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a5e120fa-a407-4dfb-b951-f2582bda5b69 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:54.764929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8356527d-05e6-47d2-8e32-159b525e0069 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:54.765537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8356527d-05e6-47d2-8e32-159b525e0069 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:54.770852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a5e120fa-a407-4dfb-b951-f2582bda5b69 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1272 microversion: 2.1 time: 0.085165 Aug 30 01:55:54.771442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 42/82] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:54 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:54.772108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8356527d-05e6-47d2-8e32-159b525e0069 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:54.772717 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8356527d-05e6-47d2-8e32-159b525e0069 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:54.773150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8356527d-05e6-47d2-8e32-159b525e0069 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:54.773843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8356527d-05e6-47d2-8e32-159b525e0069 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:54.774293 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8356527d-05e6-47d2-8e32-159b525e0069 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:54.774715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8356527d-05e6-47d2-8e32-159b525e0069 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:54.914583 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8356527d-05e6-47d2-8e32-159b525e0069 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:54.923781 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8356527d-05e6-47d2-8e32-159b525e0069 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.162534 Aug 30 01:55:54.936262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 41/83] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:54 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:55.143836 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:55.144409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:55.150948 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:55.151433 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:55.151865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:55.152584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:55.153031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:55.153450 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:55.217683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:55.227151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:55.228613 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:55.229752 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7880b580-1610-4d0c-95ad-8b4dfeab3111 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1349 microversion: 2.20 time: 0.090673 Aug 30 01:55:55.230304 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 43/84] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:55 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:55.466564 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a1feb87a-715b-4ea3-acec-7ba945226414 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:55.467269 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a1feb87a-715b-4ea3-acec-7ba945226414 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:55.474658 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1feb87a-715b-4ea3-acec-7ba945226414 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:55.475236 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1feb87a-715b-4ea3-acec-7ba945226414 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:55.475737 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1feb87a-715b-4ea3-acec-7ba945226414 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:55.476535 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1feb87a-715b-4ea3-acec-7ba945226414 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:55.477061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1feb87a-715b-4ea3-acec-7ba945226414 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:55.477546 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1feb87a-715b-4ea3-acec-7ba945226414 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:55.540964 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a1feb87a-715b-4ea3-acec-7ba945226414 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:55.549719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a1feb87a-715b-4ea3-acec-7ba945226414 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.087512 Aug 30 01:55:55.551562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 42/85] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:55 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:55.791490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-799c2797-15d8-4d8a-94ca-babc4e7bf6f1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:55.792378 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-799c2797-15d8-4d8a-94ca-babc4e7bf6f1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:55.801296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-799c2797-15d8-4d8a-94ca-babc4e7bf6f1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:55.801296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-799c2797-15d8-4d8a-94ca-babc4e7bf6f1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:55.801296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-799c2797-15d8-4d8a-94ca-babc4e7bf6f1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:55.801296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-799c2797-15d8-4d8a-94ca-babc4e7bf6f1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:55.801623 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-799c2797-15d8-4d8a-94ca-babc4e7bf6f1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:55.801623 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-799c2797-15d8-4d8a-94ca-babc4e7bf6f1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:55.864409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-799c2797-15d8-4d8a-94ca-babc4e7bf6f1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:55.871972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-799c2797-15d8-4d8a-94ca-babc4e7bf6f1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1272 microversion: 2.1 time: 0.084882 Aug 30 01:55:55.872555 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 44/86] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:55 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:55.945090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f9610749-e0b5-42e8-b490-4e8909e8af54 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:55.945724 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f9610749-e0b5-42e8-b490-4e8909e8af54 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:55.951775 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f9610749-e0b5-42e8-b490-4e8909e8af54 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:55.952282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f9610749-e0b5-42e8-b490-4e8909e8af54 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:55.952842 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f9610749-e0b5-42e8-b490-4e8909e8af54 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:55.953580 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f9610749-e0b5-42e8-b490-4e8909e8af54 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:55.954043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f9610749-e0b5-42e8-b490-4e8909e8af54 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:55.954522 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f9610749-e0b5-42e8-b490-4e8909e8af54 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:56.097004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f9610749-e0b5-42e8-b490-4e8909e8af54 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:56.104820 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f9610749-e0b5-42e8-b490-4e8909e8af54 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.163619 Aug 30 01:55:56.105381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 43/87] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:55 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:56.252954 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:56.253564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:56.259530 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:56.260006 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:56.260484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:56.261168 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:56.261618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:56.262041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:56.322176 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:56.330217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:56.331760 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:56.332883 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-47a3c21a-4901-4837-8c80-19cfb8c2a5ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1349 microversion: 2.20 time: 0.084543 Aug 30 01:55:56.333427 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 45/88] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:56 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:56.570981 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4ca5adaa-708b-44e1-ad05-2483c30db8f3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:56.571509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4ca5adaa-708b-44e1-ad05-2483c30db8f3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:56.577917 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ca5adaa-708b-44e1-ad05-2483c30db8f3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:56.578401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ca5adaa-708b-44e1-ad05-2483c30db8f3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:56.578833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ca5adaa-708b-44e1-ad05-2483c30db8f3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:56.579556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ca5adaa-708b-44e1-ad05-2483c30db8f3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:56.580005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ca5adaa-708b-44e1-ad05-2483c30db8f3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:56.580622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ca5adaa-708b-44e1-ad05-2483c30db8f3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:56.643789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4ca5adaa-708b-44e1-ad05-2483c30db8f3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:56.651428 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4ca5adaa-708b-44e1-ad05-2483c30db8f3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.084580 Aug 30 01:55:56.651988 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 44/89] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:56 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:56.894709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6a874ca6-4f8f-47ed-b87a-db10a62c7fe0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:56.895322 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6a874ca6-4f8f-47ed-b87a-db10a62c7fe0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:56.901819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a874ca6-4f8f-47ed-b87a-db10a62c7fe0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:56.902305 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a874ca6-4f8f-47ed-b87a-db10a62c7fe0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:56.902775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a874ca6-4f8f-47ed-b87a-db10a62c7fe0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:56.904017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a874ca6-4f8f-47ed-b87a-db10a62c7fe0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:56.904567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a874ca6-4f8f-47ed-b87a-db10a62c7fe0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:56.904996 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6a874ca6-4f8f-47ed-b87a-db10a62c7fe0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:56.974141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6a874ca6-4f8f-47ed-b87a-db10a62c7fe0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:56.981733 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6a874ca6-4f8f-47ed-b87a-db10a62c7fe0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1272 microversion: 2.1 time: 0.092264 Aug 30 01:55:56.982285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 46/90] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:56 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:57.124625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9fa5ac67-4898-41e4-969f-65ee036ba2d7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:57.125144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9fa5ac67-4898-41e4-969f-65ee036ba2d7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:57.133507 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9fa5ac67-4898-41e4-969f-65ee036ba2d7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:57.134231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9fa5ac67-4898-41e4-969f-65ee036ba2d7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:57.134880 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9fa5ac67-4898-41e4-969f-65ee036ba2d7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:57.135919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9fa5ac67-4898-41e4-969f-65ee036ba2d7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:57.136629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9fa5ac67-4898-41e4-969f-65ee036ba2d7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:57.137263 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9fa5ac67-4898-41e4-969f-65ee036ba2d7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:57.278975 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9fa5ac67-4898-41e4-969f-65ee036ba2d7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:57.288090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9fa5ac67-4898-41e4-969f-65ee036ba2d7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.167335 Aug 30 01:55:57.288697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 45/91] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:57 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:57.355092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:57.355694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:57.361750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:57.362259 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:57.362739 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:57.363416 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:57.363898 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:57.364348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:57.432427 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:57.442010 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:57.443459 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:57.444635 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a17e2de7-9213-4203-9883-0b7c56ea7c6e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1349 microversion: 2.20 time: 0.093532 Aug 30 01:55:57.450205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 47/92] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:57 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:57.671900 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cb173f3a-d4cd-4cfb-a839-00ade5a7b034 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:57.672475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cb173f3a-d4cd-4cfb-a839-00ade5a7b034 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:57.678700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb173f3a-d4cd-4cfb-a839-00ade5a7b034 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:57.679190 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb173f3a-d4cd-4cfb-a839-00ade5a7b034 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:57.679626 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb173f3a-d4cd-4cfb-a839-00ade5a7b034 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:57.680347 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb173f3a-d4cd-4cfb-a839-00ade5a7b034 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:57.680801 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb173f3a-d4cd-4cfb-a839-00ade5a7b034 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:57.681225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb173f3a-d4cd-4cfb-a839-00ade5a7b034 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:57.743980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cb173f3a-d4cd-4cfb-a839-00ade5a7b034 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:57.752317 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cb173f3a-d4cd-4cfb-a839-00ade5a7b034 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.084284 Aug 30 01:55:57.752878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 46/93] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:57 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:58.004867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4296fd88-cb8c-46b4-b9cc-522f38df6d03 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:58.005471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4296fd88-cb8c-46b4-b9cc-522f38df6d03 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:58.011515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4296fd88-cb8c-46b4-b9cc-522f38df6d03 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:58.011997 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4296fd88-cb8c-46b4-b9cc-522f38df6d03 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:58.012541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4296fd88-cb8c-46b4-b9cc-522f38df6d03 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:58.013264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4296fd88-cb8c-46b4-b9cc-522f38df6d03 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:58.013705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4296fd88-cb8c-46b4-b9cc-522f38df6d03 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:58.014129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4296fd88-cb8c-46b4-b9cc-522f38df6d03 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:58.226744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4296fd88-cb8c-46b4-b9cc-522f38df6d03 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:58.234399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4296fd88-cb8c-46b4-b9cc-522f38df6d03 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1272 microversion: 2.1 time: 0.234161 Aug 30 01:55:58.234959 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 48/94] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:57 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:58.308552 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8d18ff7d-6107-4fb7-acc4-044bba23a9f4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:58.309167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8d18ff7d-6107-4fb7-acc4-044bba23a9f4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:58.315164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d18ff7d-6107-4fb7-acc4-044bba23a9f4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:58.315644 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d18ff7d-6107-4fb7-acc4-044bba23a9f4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:58.316083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d18ff7d-6107-4fb7-acc4-044bba23a9f4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:58.316813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d18ff7d-6107-4fb7-acc4-044bba23a9f4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:58.317268 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d18ff7d-6107-4fb7-acc4-044bba23a9f4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:58.317692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d18ff7d-6107-4fb7-acc4-044bba23a9f4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:58.442095 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8d18ff7d-6107-4fb7-acc4-044bba23a9f4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:58.450286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8d18ff7d-6107-4fb7-acc4-044bba23a9f4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.145566 Aug 30 01:55:58.451155 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 47/95] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:58 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:58.467356 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:58.467966 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:58.474386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:58.474815 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:58.475252 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:58.475939 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:58.476423 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:58.476850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:58.537486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:58.545368 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:58.546808 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:58.547891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-71acec06-69f3-4c77-8c6a-516514ec953e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1349 microversion: 2.20 time: 0.084339 Aug 30 01:55:58.548509 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 49/96] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:58 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:58.773814 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-168b1528-fc8a-4fbe-922e-d06ed84f7193 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:58.774431 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-168b1528-fc8a-4fbe-922e-d06ed84f7193 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:58.781648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-168b1528-fc8a-4fbe-922e-d06ed84f7193 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:58.782100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-168b1528-fc8a-4fbe-922e-d06ed84f7193 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:58.783223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-168b1528-fc8a-4fbe-922e-d06ed84f7193 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:58.783868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-168b1528-fc8a-4fbe-922e-d06ed84f7193 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:58.784605 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-168b1528-fc8a-4fbe-922e-d06ed84f7193 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:58.784773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-168b1528-fc8a-4fbe-922e-d06ed84f7193 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:58.847894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-168b1528-fc8a-4fbe-922e-d06ed84f7193 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:58.856868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-168b1528-fc8a-4fbe-922e-d06ed84f7193 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.086980 Aug 30 01:55:58.857457 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 48/97] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:58 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:59.258735 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c0cfca44-7dd4-466f-beca-02448b3a00ef tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:59.259952 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c0cfca44-7dd4-466f-beca-02448b3a00ef tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:59.269915 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0cfca44-7dd4-466f-beca-02448b3a00ef tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:59.271439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0cfca44-7dd4-466f-beca-02448b3a00ef tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:59.271898 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0cfca44-7dd4-466f-beca-02448b3a00ef tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:59.272653 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0cfca44-7dd4-466f-beca-02448b3a00ef tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:59.273135 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0cfca44-7dd4-466f-beca-02448b3a00ef tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:59.279254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0cfca44-7dd4-466f-beca-02448b3a00ef tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:59.355001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c0cfca44-7dd4-466f-beca-02448b3a00ef tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:59.364134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c0cfca44-7dd4-466f-beca-02448b3a00ef tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1272 microversion: 2.1 time: 0.110465 Aug 30 01:55:59.364753 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 50/98] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:59 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:59.469871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0ebff474-05e1-46be-ace6-083a721b04a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:59.470492 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0ebff474-05e1-46be-ace6-083a721b04a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:59.476384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ebff474-05e1-46be-ace6-083a721b04a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:59.476855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ebff474-05e1-46be-ace6-083a721b04a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:59.477275 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ebff474-05e1-46be-ace6-083a721b04a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:59.477942 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ebff474-05e1-46be-ace6-083a721b04a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:59.478381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ebff474-05e1-46be-ace6-083a721b04a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:59.478792 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ebff474-05e1-46be-ace6-083a721b04a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:59.571116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:59.571725 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:59.577756 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:59.578236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:59.578660 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:59.579346 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:59.579787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:59.580205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:59.617809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0ebff474-05e1-46be-ace6-083a721b04a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:59.626089 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0ebff474-05e1-46be-ace6-083a721b04a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.159770 Aug 30 01:55:59.627269 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 49/99] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:59 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:59.649791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:59.658343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:59.659791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:59.660897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2d916b62-0317-401f-867e-544ce7230f8e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1349 microversion: 2.20 time: 0.094189 Aug 30 01:55:59.661435 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 51/100] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:55:59 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:55:59.877706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9f1ceb1d-71a2-452c-848a-bf353db6f0f8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:59.878308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9f1ceb1d-71a2-452c-848a-bf353db6f0f8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:55:59.884316 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f1ceb1d-71a2-452c-848a-bf353db6f0f8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:59.884880 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f1ceb1d-71a2-452c-848a-bf353db6f0f8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:59.885389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f1ceb1d-71a2-452c-848a-bf353db6f0f8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:59.886275 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f1ceb1d-71a2-452c-848a-bf353db6f0f8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:55:59.886799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f1ceb1d-71a2-452c-848a-bf353db6f0f8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:55:59.887348 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f1ceb1d-71a2-452c-848a-bf353db6f0f8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:55:59.953499 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9f1ceb1d-71a2-452c-848a-bf353db6f0f8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:55:59.961932 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9f1ceb1d-71a2-452c-848a-bf353db6f0f8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.088151 Aug 30 01:55:59.962588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 50/101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:55:59 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:00.385825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cd01e50-961d-4efa-b2c4-21d6663b6bb8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:00.386481 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7cd01e50-961d-4efa-b2c4-21d6663b6bb8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:00.393580 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cd01e50-961d-4efa-b2c4-21d6663b6bb8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:00.394066 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cd01e50-961d-4efa-b2c4-21d6663b6bb8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:00.394493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cd01e50-961d-4efa-b2c4-21d6663b6bb8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:00.395488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cd01e50-961d-4efa-b2c4-21d6663b6bb8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:00.395613 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cd01e50-961d-4efa-b2c4-21d6663b6bb8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:00.396279 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cd01e50-961d-4efa-b2c4-21d6663b6bb8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:00.522559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7cd01e50-961d-4efa-b2c4-21d6663b6bb8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:00.532520 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7cd01e50-961d-4efa-b2c4-21d6663b6bb8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1272 microversion: 2.1 time: 0.150358 Aug 30 01:56:00.533082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 52/102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:00 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:00.653513 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a5091a10-037c-4782-b9ea-dbf5183d4804 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:00.654683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a5091a10-037c-4782-b9ea-dbf5183d4804 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:00.671863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5091a10-037c-4782-b9ea-dbf5183d4804 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:00.672862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5091a10-037c-4782-b9ea-dbf5183d4804 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:00.674283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5091a10-037c-4782-b9ea-dbf5183d4804 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:00.676541 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5091a10-037c-4782-b9ea-dbf5183d4804 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:00.682437 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5091a10-037c-4782-b9ea-dbf5183d4804 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:00.683240 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5091a10-037c-4782-b9ea-dbf5183d4804 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:00.684980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:00.685958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:00.698689 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:00.699351 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:00.699929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:00.709437 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:00.710153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:00.710763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:00.741682 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:00.878027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:00.893932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:00.898214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:00.900192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c4003d53-8987-4d88-8a7a-b5461f97beaf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1337 microversion: 2.20 time: 0.220411 Aug 30 01:56:00.911924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 53/103] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:00 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1337 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:56:00.982912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-91b32582-c5df-46e1-97e5-a564c9ff30d4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:00.983627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-91b32582-c5df-46e1-97e5-a564c9ff30d4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:00.991950 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91b32582-c5df-46e1-97e5-a564c9ff30d4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:00.992637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91b32582-c5df-46e1-97e5-a564c9ff30d4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:00.993142 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91b32582-c5df-46e1-97e5-a564c9ff30d4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:00.994097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91b32582-c5df-46e1-97e5-a564c9ff30d4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:00.994687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91b32582-c5df-46e1-97e5-a564c9ff30d4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:00.995180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91b32582-c5df-46e1-97e5-a564c9ff30d4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:01.102964 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a5091a10-037c-4782-b9ea-dbf5183d4804 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:01.115305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a5091a10-037c-4782-b9ea-dbf5183d4804 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.470032 Aug 30 01:56:01.116032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 51/104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:00 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:01.159123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-91b32582-c5df-46e1-97e5-a564c9ff30d4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:01.178164 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-91b32582-c5df-46e1-97e5-a564c9ff30d4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1295 microversion: 2.1 time: 0.198873 Aug 30 01:56:01.194375 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 54/105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:00 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1295 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:01.554194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-20eeeac4-3ebc-4131-a994-eeae6f155a4e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:01.554798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-20eeeac4-3ebc-4131-a994-eeae6f155a4e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:01.567566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-20eeeac4-3ebc-4131-a994-eeae6f155a4e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:01.568086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-20eeeac4-3ebc-4131-a994-eeae6f155a4e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:01.568548 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-20eeeac4-3ebc-4131-a994-eeae6f155a4e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:01.569759 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-20eeeac4-3ebc-4131-a994-eeae6f155a4e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:01.570506 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-20eeeac4-3ebc-4131-a994-eeae6f155a4e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:01.570924 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-20eeeac4-3ebc-4131-a994-eeae6f155a4e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:01.936686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-20eeeac4-3ebc-4131-a994-eeae6f155a4e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:01.938313 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:01.940637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:01.948003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-20eeeac4-3ebc-4131-a994-eeae6f155a4e tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.397702 Aug 30 01:56:01.948858 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 52/106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:01 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:01.969449 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:01.973281 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:01.974114 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:01.981429 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:01.985504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:01.986600 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:02.146380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-79bb839e-85a7-45c4-82cf-ade424e29da4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:02.146988 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-79bb839e-85a7-45c4-82cf-ade424e29da4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:02.161426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-79bb839e-85a7-45c4-82cf-ade424e29da4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:02.162118 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-79bb839e-85a7-45c4-82cf-ade424e29da4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:02.162802 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-79bb839e-85a7-45c4-82cf-ade424e29da4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:02.163645 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-79bb839e-85a7-45c4-82cf-ade424e29da4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:02.164289 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-79bb839e-85a7-45c4-82cf-ade424e29da4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:02.164847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-79bb839e-85a7-45c4-82cf-ade424e29da4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:02.594279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-79bb839e-85a7-45c4-82cf-ade424e29da4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:02.602954 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-79bb839e-85a7-45c4-82cf-ade424e29da4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.463347 Aug 30 01:56:02.607177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 53/107] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:02 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:02.629171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a8837c1b-4047-4686-b60e-aad7d98abc8a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:02.629776 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a8837c1b-4047-4686-b60e-aad7d98abc8a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:02.643280 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:02.644307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a8837c1b-4047-4686-b60e-aad7d98abc8a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:02.644809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a8837c1b-4047-4686-b60e-aad7d98abc8a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:02.645236 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a8837c1b-4047-4686-b60e-aad7d98abc8a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:02.646392 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a8837c1b-4047-4686-b60e-aad7d98abc8a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:02.647440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a8837c1b-4047-4686-b60e-aad7d98abc8a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:02.648015 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a8837c1b-4047-4686-b60e-aad7d98abc8a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:02.654372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:02.656504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:02.658390 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-80380020-cea6-4551-af5b-d250ec386cd2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.727314 Aug 30 01:56:02.659749 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 55/108] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:01 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:56:02.901924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-0548c2df-edb4-4fe5-a761-f941aed4d403 req-417faccf-cc3e-4229-b513-e11a2e04bd5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f76949-51c7-4027-bca6-70e517d28eec", "tag": "33449dfd-7aea-47a8-bf04-2dbf480241dd"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:02.917008 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0548c2df-edb4-4fe5-a761-f941aed4d403 req-417faccf-cc3e-4229-b513-e11a2e04bd5a service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:02.917740 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0548c2df-edb4-4fe5-a761-f941aed4d403 req-417faccf-cc3e-4229-b513-e11a2e04bd5a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:02.918171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0548c2df-edb4-4fe5-a761-f941aed4d403 req-417faccf-cc3e-4229-b513-e11a2e04bd5a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:02.942811 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-0548c2df-edb4-4fe5-a761-f941aed4d403 req-417faccf-cc3e-4229-b513-e11a2e04bd5a service nova] Creating event network-changed:33449dfd-7aea-47a8-bf04-2dbf480241dd for instance 22f76949-51c7-4027-bca6-70e517d28eec on hv-cinder-81966 Aug 30 01:56:02.943803 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0548c2df-edb4-4fe5-a761-f941aed4d403 req-417faccf-cc3e-4229-b513-e11a2e04bd5a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 01:56:02.943803 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0548c2df-edb4-4fe5-a761-f941aed4d403 req-417faccf-cc3e-4229-b513-e11a2e04bd5a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 01:56:02.944933 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-788e98ac-7de5-46c0-94e0-42292d0ac24d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:02.945484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-788e98ac-7de5-46c0-94e0-42292d0ac24d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:02.945918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-788e98ac-7de5-46c0-94e0-42292d0ac24d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:02.946628 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-788e98ac-7de5-46c0-94e0-42292d0ac24d None None] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:02.947082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-788e98ac-7de5-46c0-94e0-42292d0ac24d None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:02.947561 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-788e98ac-7de5-46c0-94e0-42292d0ac24d None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:02.957915 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.compute.rpcapi [None req-788e98ac-7de5-46c0-94e0-42292d0ac24d None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 01:56:02.958811 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-788e98ac-7de5-46c0-94e0-42292d0ac24d None None] Releasing lock "compute-rpcapi-router" {{(pid=120392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 01:56:02.974388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a8837c1b-4047-4686-b60e-aad7d98abc8a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:02.982418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a8837c1b-4047-4686-b60e-aad7d98abc8a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.374110 Aug 30 01:56:02.982997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 54/109] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:02 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:02.993344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-788e98ac-7de5-46c0-94e0-42292d0ac24d None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183758 Aug 30 01:56:02.994252 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 56/110] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:56:02.995166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b27ba4e1-f31a-456f-91a7-032f30f0d53b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:02.995997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b27ba4e1-f31a-456f-91a7-032f30f0d53b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:03.002891 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b27ba4e1-f31a-456f-91a7-032f30f0d53b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:03.003686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b27ba4e1-f31a-456f-91a7-032f30f0d53b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:03.004375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b27ba4e1-f31a-456f-91a7-032f30f0d53b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:03.005453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b27ba4e1-f31a-456f-91a7-032f30f0d53b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:03.005981 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b27ba4e1-f31a-456f-91a7-032f30f0d53b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:03.006472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b27ba4e1-f31a-456f-91a7-032f30f0d53b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:03.206743 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b27ba4e1-f31a-456f-91a7-032f30f0d53b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:03.217232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b27ba4e1-f31a-456f-91a7-032f30f0d53b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.232147 Aug 30 01:56:03.218122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 55/111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:02 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:03.548668 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-11caea0f-84af-40fd-b5c1-148be155a342 req-236c5030-dafb-475c-b9ce-dd9c1f83010c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc020eb2-3c25-4134-a4c7-509b49c21851", "tag": "5a4eae3d-bb7e-4af7-bd34-515aa4be72ed"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:03.557783 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-11caea0f-84af-40fd-b5c1-148be155a342 req-236c5030-dafb-475c-b9ce-dd9c1f83010c service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:03.558249 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-11caea0f-84af-40fd-b5c1-148be155a342 req-236c5030-dafb-475c-b9ce-dd9c1f83010c service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:03.558671 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-11caea0f-84af-40fd-b5c1-148be155a342 req-236c5030-dafb-475c-b9ce-dd9c1f83010c service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:03.569520 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-11caea0f-84af-40fd-b5c1-148be155a342 req-236c5030-dafb-475c-b9ce-dd9c1f83010c service nova] Creating event network-changed:5a4eae3d-bb7e-4af7-bd34-515aa4be72ed for instance fc020eb2-3c25-4134-a4c7-509b49c21851 on hv-cinder-81966 Aug 30 01:56:03.574026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-11caea0f-84af-40fd-b5c1-148be155a342 req-236c5030-dafb-475c-b9ce-dd9c1f83010c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078457 Aug 30 01:56:03.574577 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 57/112] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:56:03.623540 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ab2e841a-48b1-4c8f-a6a2-2258f0baef48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:03.624093 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ab2e841a-48b1-4c8f-a6a2-2258f0baef48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:03.630778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ab2e841a-48b1-4c8f-a6a2-2258f0baef48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:03.631261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ab2e841a-48b1-4c8f-a6a2-2258f0baef48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:03.631693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ab2e841a-48b1-4c8f-a6a2-2258f0baef48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:03.632409 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ab2e841a-48b1-4c8f-a6a2-2258f0baef48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:03.632864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ab2e841a-48b1-4c8f-a6a2-2258f0baef48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:03.633287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ab2e841a-48b1-4c8f-a6a2-2258f0baef48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:03.651384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:03.684708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:03.685398 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:03.691976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:03.692480 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:03.692912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:03.693592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:03.694045 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:03.694463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:03.761886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ab2e841a-48b1-4c8f-a6a2-2258f0baef48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:03.774567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ab2e841a-48b1-4c8f-a6a2-2258f0baef48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.154731 Aug 30 01:56:03.789113 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 56/113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:03 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:03.830331 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:03.838432 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:03.839847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:03.840955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-60300a9c-5e10-4dff-a0be-91e853255e33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.160518 Aug 30 01:56:03.841490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 58/114] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:03 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:56:04.005408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-108bb520-0a84-4ad7-adca-b9dff8c471b9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:04.006003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-108bb520-0a84-4ad7-adca-b9dff8c471b9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:04.011797 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-108bb520-0a84-4ad7-adca-b9dff8c471b9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:04.012290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-108bb520-0a84-4ad7-adca-b9dff8c471b9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:04.012720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-108bb520-0a84-4ad7-adca-b9dff8c471b9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:04.013389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-108bb520-0a84-4ad7-adca-b9dff8c471b9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:04.013832 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-108bb520-0a84-4ad7-adca-b9dff8c471b9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:04.014244 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-108bb520-0a84-4ad7-adca-b9dff8c471b9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:04.141750 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-108bb520-0a84-4ad7-adca-b9dff8c471b9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:04.149519 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-108bb520-0a84-4ad7-adca-b9dff8c471b9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.148806 Aug 30 01:56:04.153566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 57/115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:03 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:04.239523 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2d86ad37-5f44-4f79-bafd-158877285437 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:04.240127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2d86ad37-5f44-4f79-bafd-158877285437 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:04.246137 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d86ad37-5f44-4f79-bafd-158877285437 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:04.246614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d86ad37-5f44-4f79-bafd-158877285437 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:04.247043 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d86ad37-5f44-4f79-bafd-158877285437 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:04.247728 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d86ad37-5f44-4f79-bafd-158877285437 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:04.248174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d86ad37-5f44-4f79-bafd-158877285437 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:04.248678 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d86ad37-5f44-4f79-bafd-158877285437 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:04.377232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d86ad37-5f44-4f79-bafd-158877285437 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:04.384824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2d86ad37-5f44-4f79-bafd-158877285437 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.149785 Aug 30 01:56:04.385382 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 59/116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:04 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:04.798875 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ec05c739-563a-4920-b7b9-d6c380f0d9d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:04.799461 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ec05c739-563a-4920-b7b9-d6c380f0d9d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:04.805366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec05c739-563a-4920-b7b9-d6c380f0d9d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:04.805834 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec05c739-563a-4920-b7b9-d6c380f0d9d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:04.806259 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec05c739-563a-4920-b7b9-d6c380f0d9d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:04.806931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec05c739-563a-4920-b7b9-d6c380f0d9d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:04.807375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec05c739-563a-4920-b7b9-d6c380f0d9d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:04.807792 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec05c739-563a-4920-b7b9-d6c380f0d9d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:04.863244 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:04.863918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:04.871240 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:04.872049 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:04.872733 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:04.875190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:04.876212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:04.877710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:04.955625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ec05c739-563a-4920-b7b9-d6c380f0d9d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:04.963505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ec05c739-563a-4920-b7b9-d6c380f0d9d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.168465 Aug 30 01:56:04.964079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 58/117] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:04 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:05.025683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-d5803260-8cb7-4ede-afec-0995c87be13d req-3e3d9393-d9fc-47a1-b11c-2fe82fb8f25f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51036535-5cf5-4283-b501-b0809e3f57a6", "tag": "b76470f7-925f-4c0c-b128-d7b4fbc6e636"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:05.037642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d5803260-8cb7-4ede-afec-0995c87be13d req-3e3d9393-d9fc-47a1-b11c-2fe82fb8f25f service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:05.038111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d5803260-8cb7-4ede-afec-0995c87be13d req-3e3d9393-d9fc-47a1-b11c-2fe82fb8f25f service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:05.038544 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d5803260-8cb7-4ede-afec-0995c87be13d req-3e3d9393-d9fc-47a1-b11c-2fe82fb8f25f service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:05.039462 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:05.047405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:05.048914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:05.050511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-18a5a82f-f86a-458b-8002-d5a6c2e6d466 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.191100 Aug 30 01:56:05.051154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 60/118] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:04 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:05.057083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-d5803260-8cb7-4ede-afec-0995c87be13d req-3e3d9393-d9fc-47a1-b11c-2fe82fb8f25f service nova] Creating event network-changed:b76470f7-925f-4c0c-b128-d7b4fbc6e636 for instance 51036535-5cf5-4283-b501-b0809e3f57a6 on hv-cinder-81966 Aug 30 01:56:05.057593 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d5803260-8cb7-4ede-afec-0995c87be13d req-3e3d9393-d9fc-47a1-b11c-2fe82fb8f25f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120391) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 01:56:05.057978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d5803260-8cb7-4ede-afec-0995c87be13d req-3e3d9393-d9fc-47a1-b11c-2fe82fb8f25f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120391) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 01:56:05.058976 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d0f4958-ce6a-4277-87c4-b3f929f6e710 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:05.059422 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d0f4958-ce6a-4277-87c4-b3f929f6e710 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:05.059843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d0f4958-ce6a-4277-87c4-b3f929f6e710 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:05.060594 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d0f4958-ce6a-4277-87c4-b3f929f6e710 None None] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:05.061027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d0f4958-ce6a-4277-87c4-b3f929f6e710 None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:05.061435 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d0f4958-ce6a-4277-87c4-b3f929f6e710 None None] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:05.070582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.compute.rpcapi [None req-8d0f4958-ce6a-4277-87c4-b3f929f6e710 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 01:56:05.071345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8d0f4958-ce6a-4277-87c4-b3f929f6e710 None None] Releasing lock "compute-rpcapi-router" {{(pid=120391) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 01:56:05.086127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8d0f4958-ce6a-4277-87c4-b3f929f6e710 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064020 Aug 30 01:56:05.086709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 59/119] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:56:05.170520 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4dfd8a94-8ca6-4b01-afc1-7c6ebc724c34 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:05.171118 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4dfd8a94-8ca6-4b01-afc1-7c6ebc724c34 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:05.176929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4dfd8a94-8ca6-4b01-afc1-7c6ebc724c34 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:05.177399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4dfd8a94-8ca6-4b01-afc1-7c6ebc724c34 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:05.177823 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4dfd8a94-8ca6-4b01-afc1-7c6ebc724c34 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:05.178489 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4dfd8a94-8ca6-4b01-afc1-7c6ebc724c34 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:05.178928 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4dfd8a94-8ca6-4b01-afc1-7c6ebc724c34 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:05.179337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4dfd8a94-8ca6-4b01-afc1-7c6ebc724c34 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:05.308694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4dfd8a94-8ca6-4b01-afc1-7c6ebc724c34 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:05.316786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4dfd8a94-8ca6-4b01-afc1-7c6ebc724c34 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.149965 Aug 30 01:56:05.317336 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 61/120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:05 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:05.405905 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e00a293b-b662-4cfb-be11-2f6d03bc4266 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:05.406525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e00a293b-b662-4cfb-be11-2f6d03bc4266 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:05.412599 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e00a293b-b662-4cfb-be11-2f6d03bc4266 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:05.413079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e00a293b-b662-4cfb-be11-2f6d03bc4266 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:05.413510 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e00a293b-b662-4cfb-be11-2f6d03bc4266 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:05.414217 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e00a293b-b662-4cfb-be11-2f6d03bc4266 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:05.414666 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e00a293b-b662-4cfb-be11-2f6d03bc4266 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:05.415089 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e00a293b-b662-4cfb-be11-2f6d03bc4266 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:05.555862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e00a293b-b662-4cfb-be11-2f6d03bc4266 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:05.563540 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e00a293b-b662-4cfb-be11-2f6d03bc4266 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.161862 Aug 30 01:56:05.564106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 60/121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:05 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:05.983026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d4be6e19-5e51-4a70-a5ff-301def1814cd tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:05.983626 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d4be6e19-5e51-4a70-a5ff-301def1814cd tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:05.990210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4be6e19-5e51-4a70-a5ff-301def1814cd tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:05.990685 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4be6e19-5e51-4a70-a5ff-301def1814cd tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:05.991113 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4be6e19-5e51-4a70-a5ff-301def1814cd tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:05.991783 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4be6e19-5e51-4a70-a5ff-301def1814cd tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:05.992288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4be6e19-5e51-4a70-a5ff-301def1814cd tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:05.992709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d4be6e19-5e51-4a70-a5ff-301def1814cd tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:06.073436 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:06.074037 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:06.080666 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:06.081388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:06.081879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:06.082625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:06.083216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:06.083636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:06.126511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d4be6e19-5e51-4a70-a5ff-301def1814cd tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:06.145544 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d4be6e19-5e51-4a70-a5ff-301def1814cd tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.166233 Aug 30 01:56:06.151241 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 62/122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:05 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:06.223340 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:06.231187 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:06.232644 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:06.233772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-aea5deff-332f-4fbd-a915-7e443ad0e2ab tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.164196 Aug 30 01:56:06.234270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 61/123] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:06 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:56:06.337155 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cbfd747-fd3a-4c3d-b631-ea9f126b822d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:06.337788 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7cbfd747-fd3a-4c3d-b631-ea9f126b822d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:06.343652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cbfd747-fd3a-4c3d-b631-ea9f126b822d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:06.344128 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cbfd747-fd3a-4c3d-b631-ea9f126b822d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:06.344585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cbfd747-fd3a-4c3d-b631-ea9f126b822d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:06.345254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cbfd747-fd3a-4c3d-b631-ea9f126b822d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:06.346308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cbfd747-fd3a-4c3d-b631-ea9f126b822d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:06.346720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cbfd747-fd3a-4c3d-b631-ea9f126b822d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:06.469869 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7cbfd747-fd3a-4c3d-b631-ea9f126b822d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:06.477256 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7cbfd747-fd3a-4c3d-b631-ea9f126b822d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.144015 Aug 30 01:56:06.477803 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 63/124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:06 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:06.586174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8bb909ac-c76d-4c5a-be73-4226e60566aa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:06.587035 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8bb909ac-c76d-4c5a-be73-4226e60566aa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:06.594967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bb909ac-c76d-4c5a-be73-4226e60566aa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:06.596920 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bb909ac-c76d-4c5a-be73-4226e60566aa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:06.597385 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bb909ac-c76d-4c5a-be73-4226e60566aa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:06.598688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bb909ac-c76d-4c5a-be73-4226e60566aa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:06.600008 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bb909ac-c76d-4c5a-be73-4226e60566aa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:06.600469 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bb909ac-c76d-4c5a-be73-4226e60566aa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:06.733688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8bb909ac-c76d-4c5a-be73-4226e60566aa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:06.741228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8bb909ac-c76d-4c5a-be73-4226e60566aa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.159651 Aug 30 01:56:06.741804 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 62/125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:06 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:07.166808 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-eee5e1ab-ca04-4a5b-9c11-f992c78f6683 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:07.168634 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-eee5e1ab-ca04-4a5b-9c11-f992c78f6683 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:07.177734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee5e1ab-ca04-4a5b-9c11-f992c78f6683 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:07.178949 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee5e1ab-ca04-4a5b-9c11-f992c78f6683 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:07.179385 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee5e1ab-ca04-4a5b-9c11-f992c78f6683 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:07.180439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee5e1ab-ca04-4a5b-9c11-f992c78f6683 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:07.181348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee5e1ab-ca04-4a5b-9c11-f992c78f6683 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:07.182181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eee5e1ab-ca04-4a5b-9c11-f992c78f6683 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:07.259053 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:07.260640 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:07.268829 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:07.269665 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:07.270549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:07.271701 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:07.272678 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:07.273493 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:07.570024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-eee5e1ab-ca04-4a5b-9c11-f992c78f6683 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:07.579256 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-eee5e1ab-ca04-4a5b-9c11-f992c78f6683 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.416089 Aug 30 01:56:07.580549 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 64/126] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:07 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:07.585311 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6bb68952-419c-47d5-a5c7-cc4e798abd80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:07.586180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6bb68952-419c-47d5-a5c7-cc4e798abd80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:07.592190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6bb68952-419c-47d5-a5c7-cc4e798abd80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:07.592831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6bb68952-419c-47d5-a5c7-cc4e798abd80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:07.593371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6bb68952-419c-47d5-a5c7-cc4e798abd80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:07.594229 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6bb68952-419c-47d5-a5c7-cc4e798abd80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:07.594825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6bb68952-419c-47d5-a5c7-cc4e798abd80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:07.595932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6bb68952-419c-47d5-a5c7-cc4e798abd80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:07.627965 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:07.639171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:07.645942 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:07.647550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2ee6e9a9-777a-42c0-b97d-3d7c7c42ccfa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.395274 Aug 30 01:56:07.661196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 63/127] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:07 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:56:07.764633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c44f0e11-491a-4c9a-bb77-9809fc8d1169 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:07.765341 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c44f0e11-491a-4c9a-bb77-9809fc8d1169 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:07.777661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c44f0e11-491a-4c9a-bb77-9809fc8d1169 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:07.778425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c44f0e11-491a-4c9a-bb77-9809fc8d1169 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:07.781866 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c44f0e11-491a-4c9a-bb77-9809fc8d1169 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:07.783626 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c44f0e11-491a-4c9a-bb77-9809fc8d1169 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:07.784292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c44f0e11-491a-4c9a-bb77-9809fc8d1169 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:07.785793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c44f0e11-491a-4c9a-bb77-9809fc8d1169 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:07.974976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6bb68952-419c-47d5-a5c7-cc4e798abd80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:07.981885 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6bb68952-419c-47d5-a5c7-cc4e798abd80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.400255 Aug 30 01:56:07.982451 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 65/128] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:07 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:07.986788 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-dbd124cb-2623-4ee0-8d8b-51f64118aff3 req-d45423d0-a45c-49a4-b1f5-b96df480c1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cf13980-f99e-4a83-9ec5-95e80147696b", "tag": "73d5c135-a67f-4c18-bc03-d0162506c894"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:07.996619 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c44f0e11-491a-4c9a-bb77-9809fc8d1169 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:08.002927 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dbd124cb-2623-4ee0-8d8b-51f64118aff3 req-d45423d0-a45c-49a4-b1f5-b96df480c1a6 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:08.003433 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dbd124cb-2623-4ee0-8d8b-51f64118aff3 req-d45423d0-a45c-49a4-b1f5-b96df480c1a6 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:08.003981 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dbd124cb-2623-4ee0-8d8b-51f64118aff3 req-d45423d0-a45c-49a4-b1f5-b96df480c1a6 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:08.005207 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c44f0e11-491a-4c9a-bb77-9809fc8d1169 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.245932 Aug 30 01:56:08.006070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 64/129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:07 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:08.015375 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-dbd124cb-2623-4ee0-8d8b-51f64118aff3 req-d45423d0-a45c-49a4-b1f5-b96df480c1a6 service nova] Creating event network-changed:73d5c135-a67f-4c18-bc03-d0162506c894 for instance 1cf13980-f99e-4a83-9ec5-95e80147696b on hv-cinder-81966 Aug 30 01:56:08.020785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-dbd124cb-2623-4ee0-8d8b-51f64118aff3 req-d45423d0-a45c-49a4-b1f5-b96df480c1a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037241 Aug 30 01:56:08.021362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 66/130] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:56:08.601121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-45db89b6-152d-4d6a-99c4-28d37d792961 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:08.602106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-45db89b6-152d-4d6a-99c4-28d37d792961 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:08.608070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45db89b6-152d-4d6a-99c4-28d37d792961 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:08.608577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45db89b6-152d-4d6a-99c4-28d37d792961 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:08.609002 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45db89b6-152d-4d6a-99c4-28d37d792961 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:08.609670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45db89b6-152d-4d6a-99c4-28d37d792961 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:08.610117 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45db89b6-152d-4d6a-99c4-28d37d792961 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:08.610528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45db89b6-152d-4d6a-99c4-28d37d792961 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:08.671729 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:08.672559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:08.679289 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:08.679770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:08.680202 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:08.680916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:08.681369 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:08.681790 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:08.740780 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-45db89b6-152d-4d6a-99c4-28d37d792961 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:08.748461 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-45db89b6-152d-4d6a-99c4-28d37d792961 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.151176 Aug 30 01:56:08.749032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 65/131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:08 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:08.813785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:08.822154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:08.823793 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:08.824924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c757497d-b2da-462d-96ec-e4cfcb90d47f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.157630 Aug 30 01:56:08.825479 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 67/132] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:08 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:09.001925 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fd47b2aa-1a04-456a-8725-7f9d9cd8997d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:09.002527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-fd47b2aa-1a04-456a-8725-7f9d9cd8997d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:09.008495 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fd47b2aa-1a04-456a-8725-7f9d9cd8997d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:09.008967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fd47b2aa-1a04-456a-8725-7f9d9cd8997d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:09.009391 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fd47b2aa-1a04-456a-8725-7f9d9cd8997d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:09.010064 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fd47b2aa-1a04-456a-8725-7f9d9cd8997d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:09.010506 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fd47b2aa-1a04-456a-8725-7f9d9cd8997d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:09.010918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fd47b2aa-1a04-456a-8725-7f9d9cd8997d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:09.026306 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-17a9ff01-f43b-4b1a-9023-11943c7e7381 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:09.026912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-17a9ff01-f43b-4b1a-9023-11943c7e7381 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:09.032915 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17a9ff01-f43b-4b1a-9023-11943c7e7381 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:09.033912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17a9ff01-f43b-4b1a-9023-11943c7e7381 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:09.034341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17a9ff01-f43b-4b1a-9023-11943c7e7381 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:09.035024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17a9ff01-f43b-4b1a-9023-11943c7e7381 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:09.035473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17a9ff01-f43b-4b1a-9023-11943c7e7381 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:09.035891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17a9ff01-f43b-4b1a-9023-11943c7e7381 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:09.145125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-fd47b2aa-1a04-456a-8725-7f9d9cd8997d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:09.152794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-fd47b2aa-1a04-456a-8725-7f9d9cd8997d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.154940 Aug 30 01:56:09.153351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 66/133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:08 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:09.171440 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-17a9ff01-f43b-4b1a-9023-11943c7e7381 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:09.179025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-17a9ff01-f43b-4b1a-9023-11943c7e7381 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.156493 Aug 30 01:56:09.179584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 68/134] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:09 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:09.769718 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6dd67b64-0946-4d02-9140-663be8d0378f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:09.770258 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6dd67b64-0946-4d02-9140-663be8d0378f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:09.776409 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dd67b64-0946-4d02-9140-663be8d0378f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:09.777096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dd67b64-0946-4d02-9140-663be8d0378f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:09.777525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dd67b64-0946-4d02-9140-663be8d0378f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:09.778219 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dd67b64-0946-4d02-9140-663be8d0378f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:09.778664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dd67b64-0946-4d02-9140-663be8d0378f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:09.779081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dd67b64-0946-4d02-9140-663be8d0378f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:09.847644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:09.848277 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:09.854460 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:09.854789 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:09.855257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:09.855957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:09.856431 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:09.856853 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:10.002547 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:10.011116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:10.012612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:10.013708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-96ca91b8-86e6-4e8d-b29d-4466537822fb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.170540 Aug 30 01:56:10.014265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 69/135] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:09 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:56:10.054172 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6dd67b64-0946-4d02-9140-663be8d0378f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:10.063343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6dd67b64-0946-4d02-9140-663be8d0378f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.297993 Aug 30 01:56:10.064137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 67/136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:09 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:10.173973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ae1cae98-8cfd-4680-a8fa-03a6386f41a5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:10.174738 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ae1cae98-8cfd-4680-a8fa-03a6386f41a5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:10.182313 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae1cae98-8cfd-4680-a8fa-03a6386f41a5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:10.182895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae1cae98-8cfd-4680-a8fa-03a6386f41a5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:10.183387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae1cae98-8cfd-4680-a8fa-03a6386f41a5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:10.184135 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae1cae98-8cfd-4680-a8fa-03a6386f41a5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:10.184670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae1cae98-8cfd-4680-a8fa-03a6386f41a5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:10.185148 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae1cae98-8cfd-4680-a8fa-03a6386f41a5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:10.199132 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c8e2b40d-e36c-41d2-8863-a36d9ca347c0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:10.199760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c8e2b40d-e36c-41d2-8863-a36d9ca347c0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:10.206646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c8e2b40d-e36c-41d2-8863-a36d9ca347c0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:10.207126 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c8e2b40d-e36c-41d2-8863-a36d9ca347c0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:10.207556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c8e2b40d-e36c-41d2-8863-a36d9ca347c0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:10.208254 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c8e2b40d-e36c-41d2-8863-a36d9ca347c0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:10.208711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c8e2b40d-e36c-41d2-8863-a36d9ca347c0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:10.209128 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c8e2b40d-e36c-41d2-8863-a36d9ca347c0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:10.318125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ae1cae98-8cfd-4680-a8fa-03a6386f41a5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:10.329319 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ae1cae98-8cfd-4680-a8fa-03a6386f41a5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.159700 Aug 30 01:56:10.330614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 70/137] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:10 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:10.347078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c8e2b40d-e36c-41d2-8863-a36d9ca347c0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:10.356657 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c8e2b40d-e36c-41d2-8863-a36d9ca347c0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.161400 Aug 30 01:56:10.357216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 68/138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:10 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:11.036750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:11.037465 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:11.043453 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:11.043928 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:11.044383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:11.045063 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:11.045511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:11.045932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:11.082730 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-86a26685-ce7c-488a-b2ca-786fa83b35b2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:11.083342 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-86a26685-ce7c-488a-b2ca-786fa83b35b2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:11.089222 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86a26685-ce7c-488a-b2ca-786fa83b35b2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:11.089706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86a26685-ce7c-488a-b2ca-786fa83b35b2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:11.090137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86a26685-ce7c-488a-b2ca-786fa83b35b2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:11.090835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86a26685-ce7c-488a-b2ca-786fa83b35b2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:11.091289 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86a26685-ce7c-488a-b2ca-786fa83b35b2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:11.091713 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86a26685-ce7c-488a-b2ca-786fa83b35b2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:11.176518 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:11.180008 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:11.185284 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:11.186952 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:11.188049 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cd551a14-ada1-4f50-8082-e9a31d6ff9ad tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.155677 Aug 30 01:56:11.188640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 71/139] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:11 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:11.226198 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-86a26685-ce7c-488a-b2ca-786fa83b35b2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:11.233993 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-86a26685-ce7c-488a-b2ca-786fa83b35b2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.155033 Aug 30 01:56:11.234625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 69/140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:11 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:11.350397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-20ed7dbf-2d08-411c-b7fe-661c126d330d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:11.350993 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-20ed7dbf-2d08-411c-b7fe-661c126d330d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:11.357017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-20ed7dbf-2d08-411c-b7fe-661c126d330d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:11.357490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-20ed7dbf-2d08-411c-b7fe-661c126d330d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:11.357913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-20ed7dbf-2d08-411c-b7fe-661c126d330d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:11.358586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-20ed7dbf-2d08-411c-b7fe-661c126d330d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:11.359029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-20ed7dbf-2d08-411c-b7fe-661c126d330d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:11.359444 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-20ed7dbf-2d08-411c-b7fe-661c126d330d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:11.377810 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-edb1253e-cfd5-4532-acc7-cb5ab3fb2fe5 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:11.378409 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-edb1253e-cfd5-4532-acc7-cb5ab3fb2fe5 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:11.384081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb1253e-cfd5-4532-acc7-cb5ab3fb2fe5 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:11.384586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb1253e-cfd5-4532-acc7-cb5ab3fb2fe5 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:11.385013 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb1253e-cfd5-4532-acc7-cb5ab3fb2fe5 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:11.385686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb1253e-cfd5-4532-acc7-cb5ab3fb2fe5 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:11.386130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb1253e-cfd5-4532-acc7-cb5ab3fb2fe5 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:11.386541 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb1253e-cfd5-4532-acc7-cb5ab3fb2fe5 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:11.497555 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-20ed7dbf-2d08-411c-b7fe-661c126d330d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:11.506191 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-20ed7dbf-2d08-411c-b7fe-661c126d330d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.159942 Aug 30 01:56:11.507022 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 72/141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:11 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:11.543693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-edb1253e-cfd5-4532-acc7-cb5ab3fb2fe5 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:11.551881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-edb1253e-cfd5-4532-acc7-cb5ab3fb2fe5 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.178578 Aug 30 01:56:11.552409 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 70/142] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:11 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:12.210759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:12.211611 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:12.217597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:12.218081 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:12.218514 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:12.219194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:12.219643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:12.220062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:12.254257 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0cc97561-402a-485a-9a64-f9a7d94f1d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:12.254857 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0cc97561-402a-485a-9a64-f9a7d94f1d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:12.260928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0cc97561-402a-485a-9a64-f9a7d94f1d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:12.261406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0cc97561-402a-485a-9a64-f9a7d94f1d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:12.261884 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0cc97561-402a-485a-9a64-f9a7d94f1d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:12.262573 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0cc97561-402a-485a-9a64-f9a7d94f1d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:12.263014 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0cc97561-402a-485a-9a64-f9a7d94f1d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:12.263429 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0cc97561-402a-485a-9a64-f9a7d94f1d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:12.366038 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:12.375862 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:12.394706 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:12.395962 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-daa31258-aac3-499e-86ea-5cf1d2c5c9f4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.189166 Aug 30 01:56:12.396700 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 73/143] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:12 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:12.414414 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0cc97561-402a-485a-9a64-f9a7d94f1d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:12.422327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0cc97561-402a-485a-9a64-f9a7d94f1d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.172084 Aug 30 01:56:12.422897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 71/144] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:12 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:12.531567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-439d9f07-ad3c-456f-99d5-12a8d68a1de5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:12.532173 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-439d9f07-ad3c-456f-99d5-12a8d68a1de5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:12.538016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439d9f07-ad3c-456f-99d5-12a8d68a1de5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:12.538495 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439d9f07-ad3c-456f-99d5-12a8d68a1de5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:12.538909 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439d9f07-ad3c-456f-99d5-12a8d68a1de5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:12.539585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439d9f07-ad3c-456f-99d5-12a8d68a1de5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:12.540025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439d9f07-ad3c-456f-99d5-12a8d68a1de5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:12.540466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439d9f07-ad3c-456f-99d5-12a8d68a1de5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:12.576648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e1eeccd0-0a60-4f13-9148-93e26e80209b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:12.577653 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e1eeccd0-0a60-4f13-9148-93e26e80209b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:12.588119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1eeccd0-0a60-4f13-9148-93e26e80209b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:12.589087 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1eeccd0-0a60-4f13-9148-93e26e80209b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:12.590057 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1eeccd0-0a60-4f13-9148-93e26e80209b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:12.591387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1eeccd0-0a60-4f13-9148-93e26e80209b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:12.592191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1eeccd0-0a60-4f13-9148-93e26e80209b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:12.592708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1eeccd0-0a60-4f13-9148-93e26e80209b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:12.683314 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-439d9f07-ad3c-456f-99d5-12a8d68a1de5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:12.692626 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-439d9f07-ad3c-456f-99d5-12a8d68a1de5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.165324 Aug 30 01:56:12.693426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 74/145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:12 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:12.727508 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e1eeccd0-0a60-4f13-9148-93e26e80209b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:12.735108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e1eeccd0-0a60-4f13-9148-93e26e80209b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.165039 Aug 30 01:56:12.735671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 72/146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:12 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:13.422532 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:13.423116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:13.425751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:13.432317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:13.432924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:13.433347 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:13.434061 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:13.434540 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:13.434944 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:13.443673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5ab4800d-645d-4a59-992f-0fa134901466 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:13.444347 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5ab4800d-645d-4a59-992f-0fa134901466 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:13.450608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ab4800d-645d-4a59-992f-0fa134901466 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:13.451091 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ab4800d-645d-4a59-992f-0fa134901466 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:13.451520 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ab4800d-645d-4a59-992f-0fa134901466 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:13.452201 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ab4800d-645d-4a59-992f-0fa134901466 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:13.452711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ab4800d-645d-4a59-992f-0fa134901466 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:13.453131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ab4800d-645d-4a59-992f-0fa134901466 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:13.478621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:13.602986 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:13.614742 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:13.616419 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ab4800d-645d-4a59-992f-0fa134901466 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:13.616609 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:13.618976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d1c1ac8e-c4a7-433e-9dd7-16458a7785a2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.199009 Aug 30 01:56:13.632285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 75/147] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:13 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:13.644115 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5ab4800d-645d-4a59-992f-0fa134901466 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.204868 Aug 30 01:56:13.645526 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 73/148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:13 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:13.713737 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-990151b4-4437-4413-90c8-11280e7ca756 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:13.714234 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-990151b4-4437-4413-90c8-11280e7ca756 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:13.720016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-990151b4-4437-4413-90c8-11280e7ca756 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:13.721107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-990151b4-4437-4413-90c8-11280e7ca756 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:13.721537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-990151b4-4437-4413-90c8-11280e7ca756 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:13.722222 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-990151b4-4437-4413-90c8-11280e7ca756 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:13.722670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-990151b4-4437-4413-90c8-11280e7ca756 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:13.723087 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-990151b4-4437-4413-90c8-11280e7ca756 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:13.756049 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2ba5d724-b185-449f-bf0e-f1cb8df0b2db tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:13.756714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2ba5d724-b185-449f-bf0e-f1cb8df0b2db tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:13.762630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ba5d724-b185-449f-bf0e-f1cb8df0b2db tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:13.763103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ba5d724-b185-449f-bf0e-f1cb8df0b2db tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:13.763529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ba5d724-b185-449f-bf0e-f1cb8df0b2db tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:13.764205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ba5d724-b185-449f-bf0e-f1cb8df0b2db tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:13.764828 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ba5d724-b185-449f-bf0e-f1cb8df0b2db tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:13.765244 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ba5d724-b185-449f-bf0e-f1cb8df0b2db tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:13.886216 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-990151b4-4437-4413-90c8-11280e7ca756 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:13.898151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-990151b4-4437-4413-90c8-11280e7ca756 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.188147 Aug 30 01:56:13.899010 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 76/149] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:13 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:13.912683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2ba5d724-b185-449f-bf0e-f1cb8df0b2db tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:13.920440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2ba5d724-b185-449f-bf0e-f1cb8df0b2db tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.168455 Aug 30 01:56:13.920877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 74/150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:13 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:14.645779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:14.646327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:14.652609 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:14.653080 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:14.653502 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:14.654171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:14.654613 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:14.655023 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:14.665358 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a515c786-df55-4080-b821-692060bedd3d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:14.665960 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a515c786-df55-4080-b821-692060bedd3d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:14.671765 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a515c786-df55-4080-b821-692060bedd3d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:14.672532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a515c786-df55-4080-b821-692060bedd3d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:14.673324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a515c786-df55-4080-b821-692060bedd3d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:14.674788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a515c786-df55-4080-b821-692060bedd3d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:14.675450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a515c786-df55-4080-b821-692060bedd3d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:14.675654 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a515c786-df55-4080-b821-692060bedd3d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:14.796858 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:14.805632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:14.807127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:14.808292 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6df1736c-abcf-45a3-852f-09405d73f6ef tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.166374 Aug 30 01:56:14.809034 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 77/151] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:14 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:14.824175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a515c786-df55-4080-b821-692060bedd3d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:14.832447 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a515c786-df55-4080-b821-692060bedd3d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.170929 Aug 30 01:56:14.833122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 75/152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:14 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:14.918662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-99955595-c61f-41c3-9216-73052c66f151 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:14.919189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-99955595-c61f-41c3-9216-73052c66f151 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:14.925388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99955595-c61f-41c3-9216-73052c66f151 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:14.925968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99955595-c61f-41c3-9216-73052c66f151 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:14.926421 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99955595-c61f-41c3-9216-73052c66f151 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:14.927091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99955595-c61f-41c3-9216-73052c66f151 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:14.927531 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99955595-c61f-41c3-9216-73052c66f151 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:14.927944 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99955595-c61f-41c3-9216-73052c66f151 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:14.942090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e5e1ca27-0e16-4b92-bb00-2d9ca6d89283 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:14.943352 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e5e1ca27-0e16-4b92-bb00-2d9ca6d89283 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:14.949088 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e5e1ca27-0e16-4b92-bb00-2d9ca6d89283 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:14.949566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e5e1ca27-0e16-4b92-bb00-2d9ca6d89283 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:14.950357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e5e1ca27-0e16-4b92-bb00-2d9ca6d89283 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:14.951037 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e5e1ca27-0e16-4b92-bb00-2d9ca6d89283 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:14.951481 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e5e1ca27-0e16-4b92-bb00-2d9ca6d89283 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:14.951897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e5e1ca27-0e16-4b92-bb00-2d9ca6d89283 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:15.057603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-99955595-c61f-41c3-9216-73052c66f151 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:15.065935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-99955595-c61f-41c3-9216-73052c66f151 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.151086 Aug 30 01:56:15.066490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 78/153] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:14 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:15.068396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:15.080023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e5e1ca27-0e16-4b92-bb00-2d9ca6d89283 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:15.087431 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e5e1ca27-0e16-4b92-bb00-2d9ca6d89283 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.149581 Aug 30 01:56:15.087982 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 76/154] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:14 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:15.832482 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:15.833080 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:15.839133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:15.839608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:15.840031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:15.840741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:15.841192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:15.841602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:15.852576 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bfc4cf3d-b718-4a24-9c9d-362d2749e316 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:15.853182 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bfc4cf3d-b718-4a24-9c9d-362d2749e316 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:15.858966 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bfc4cf3d-b718-4a24-9c9d-362d2749e316 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:15.859433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bfc4cf3d-b718-4a24-9c9d-362d2749e316 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:15.859856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bfc4cf3d-b718-4a24-9c9d-362d2749e316 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:15.860560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bfc4cf3d-b718-4a24-9c9d-362d2749e316 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:15.861000 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bfc4cf3d-b718-4a24-9c9d-362d2749e316 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:15.861417 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bfc4cf3d-b718-4a24-9c9d-362d2749e316 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:15.973671 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:15.981955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:15.983373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:15.984552 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f277b28c-2e7a-4dd3-987a-8a6e1f20f03c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.156406 Aug 30 01:56:15.985104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 79/155] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:15 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:15.992342 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-bfc4cf3d-b718-4a24-9c9d-362d2749e316 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:15.999839 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bfc4cf3d-b718-4a24-9c9d-362d2749e316 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.151086 Aug 30 01:56:16.000425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 77/156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:15 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:16.086762 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-17979d8f-bcc2-4fa5-9e03-2712c0e74fed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:16.087286 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-17979d8f-bcc2-4fa5-9e03-2712c0e74fed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:16.093172 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17979d8f-bcc2-4fa5-9e03-2712c0e74fed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:16.093646 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17979d8f-bcc2-4fa5-9e03-2712c0e74fed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:16.094073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17979d8f-bcc2-4fa5-9e03-2712c0e74fed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:16.094746 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17979d8f-bcc2-4fa5-9e03-2712c0e74fed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:16.095192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17979d8f-bcc2-4fa5-9e03-2712c0e74fed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:16.095608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17979d8f-bcc2-4fa5-9e03-2712c0e74fed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:16.106788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1db0a65f-58e9-4769-b86a-06d2ee941801 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:16.107426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1db0a65f-58e9-4769-b86a-06d2ee941801 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:16.113879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1db0a65f-58e9-4769-b86a-06d2ee941801 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:16.114362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1db0a65f-58e9-4769-b86a-06d2ee941801 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:16.114794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1db0a65f-58e9-4769-b86a-06d2ee941801 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:16.115479 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1db0a65f-58e9-4769-b86a-06d2ee941801 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:16.115930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1db0a65f-58e9-4769-b86a-06d2ee941801 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:16.116380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1db0a65f-58e9-4769-b86a-06d2ee941801 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:16.222304 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-17979d8f-bcc2-4fa5-9e03-2712c0e74fed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:16.229983 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-17979d8f-bcc2-4fa5-9e03-2712c0e74fed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.147035 Aug 30 01:56:16.230542 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 80/157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:16 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:16.243818 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1db0a65f-58e9-4769-b86a-06d2ee941801 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:16.251646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1db0a65f-58e9-4769-b86a-06d2ee941801 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.148618 Aug 30 01:56:16.252203 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 78/158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:16 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:17.007575 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:17.008172 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:17.014170 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:17.014638 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:17.015065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:17.016907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:17.016907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:17.017866 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:17.022747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2d74e4ae-7ef1-4e51-a0d1-c026673f3229 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:17.023484 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2d74e4ae-7ef1-4e51-a0d1-c026673f3229 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:17.029846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d74e4ae-7ef1-4e51-a0d1-c026673f3229 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:17.030424 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d74e4ae-7ef1-4e51-a0d1-c026673f3229 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:17.030958 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d74e4ae-7ef1-4e51-a0d1-c026673f3229 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:17.031744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d74e4ae-7ef1-4e51-a0d1-c026673f3229 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:17.032321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d74e4ae-7ef1-4e51-a0d1-c026673f3229 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:17.032906 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d74e4ae-7ef1-4e51-a0d1-c026673f3229 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:17.171953 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:17.181264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:17.182411 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:17.183511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-530e67e3-f726-4c94-b2f8-33c6789c34e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.179844 Aug 30 01:56:17.184280 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 81/159] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:17 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:17.193986 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2d74e4ae-7ef1-4e51-a0d1-c026673f3229 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:17.208798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2d74e4ae-7ef1-4e51-a0d1-c026673f3229 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.189705 Aug 30 01:56:17.209371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 79/160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:17 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:17.252496 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-74069aaa-9c91-4267-a05d-fd0c0f424381 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:17.253099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-74069aaa-9c91-4267-a05d-fd0c0f424381 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:17.259340 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74069aaa-9c91-4267-a05d-fd0c0f424381 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:17.259806 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74069aaa-9c91-4267-a05d-fd0c0f424381 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:17.260277 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74069aaa-9c91-4267-a05d-fd0c0f424381 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:17.261031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74069aaa-9c91-4267-a05d-fd0c0f424381 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:17.261838 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74069aaa-9c91-4267-a05d-fd0c0f424381 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:17.262019 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74069aaa-9c91-4267-a05d-fd0c0f424381 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:17.272975 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bc450f55-4bc1-42ed-8492-1450cf2faffa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:17.274013 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bc450f55-4bc1-42ed-8492-1450cf2faffa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:17.283642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc450f55-4bc1-42ed-8492-1450cf2faffa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:17.283642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc450f55-4bc1-42ed-8492-1450cf2faffa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:17.283642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc450f55-4bc1-42ed-8492-1450cf2faffa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:17.283642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc450f55-4bc1-42ed-8492-1450cf2faffa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:17.284180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc450f55-4bc1-42ed-8492-1450cf2faffa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:17.284180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc450f55-4bc1-42ed-8492-1450cf2faffa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:17.431115 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-74069aaa-9c91-4267-a05d-fd0c0f424381 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:17.431335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-bc450f55-4bc1-42ed-8492-1450cf2faffa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:17.437183 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-74069aaa-9c91-4267-a05d-fd0c0f424381 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.189090 Aug 30 01:56:17.437836 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 82/161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:17 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:17.439315 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bc450f55-4bc1-42ed-8492-1450cf2faffa tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.170446 Aug 30 01:56:17.439869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 80/162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:17 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:18.207964 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:18.208515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:18.214344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:18.214814 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:18.215239 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:18.215908 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:18.216374 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:18.216788 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:18.229645 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e13f3900-de4c-4f02-a69a-829a3c7df096 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:18.230252 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e13f3900-de4c-4f02-a69a-829a3c7df096 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:18.236657 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e13f3900-de4c-4f02-a69a-829a3c7df096 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:18.237132 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e13f3900-de4c-4f02-a69a-829a3c7df096 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:18.237557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e13f3900-de4c-4f02-a69a-829a3c7df096 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:18.238235 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e13f3900-de4c-4f02-a69a-829a3c7df096 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:18.238684 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e13f3900-de4c-4f02-a69a-829a3c7df096 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:18.239106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e13f3900-de4c-4f02-a69a-829a3c7df096 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:18.343463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:18.352229 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:18.353811 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:18.355448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-646a2019-7a37-4afc-98d4-3a9739637a3b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.151162 Aug 30 01:56:18.356222 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 83/163] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:18 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:18.377844 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e13f3900-de4c-4f02-a69a-829a3c7df096 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:18.385715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e13f3900-de4c-4f02-a69a-829a3c7df096 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.159916 Aug 30 01:56:18.386276 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 81/164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:18 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:18.457702 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-556df2a5-0ff6-4787-a3f7-70309ef7869a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:18.458489 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-556df2a5-0ff6-4787-a3f7-70309ef7869a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:18.461621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6919128b-e567-4c27-a99d-94f64b9aa759 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:18.462226 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6919128b-e567-4c27-a99d-94f64b9aa759 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:18.464602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-556df2a5-0ff6-4787-a3f7-70309ef7869a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:18.465080 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-556df2a5-0ff6-4787-a3f7-70309ef7869a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:18.465502 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-556df2a5-0ff6-4787-a3f7-70309ef7869a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:18.466201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-556df2a5-0ff6-4787-a3f7-70309ef7869a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:18.466622 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-556df2a5-0ff6-4787-a3f7-70309ef7869a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:18.467028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-556df2a5-0ff6-4787-a3f7-70309ef7869a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:18.468525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6919128b-e567-4c27-a99d-94f64b9aa759 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:18.469083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6919128b-e567-4c27-a99d-94f64b9aa759 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:18.469584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6919128b-e567-4c27-a99d-94f64b9aa759 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:18.470876 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6919128b-e567-4c27-a99d-94f64b9aa759 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:18.471410 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6919128b-e567-4c27-a99d-94f64b9aa759 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:18.471913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6919128b-e567-4c27-a99d-94f64b9aa759 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:18.598790 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-556df2a5-0ff6-4787-a3f7-70309ef7869a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:18.599807 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6919128b-e567-4c27-a99d-94f64b9aa759 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:18.607187 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-556df2a5-0ff6-4787-a3f7-70309ef7869a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.153207 Aug 30 01:56:18.607422 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6919128b-e567-4c27-a99d-94f64b9aa759 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.149487 Aug 30 01:56:18.607825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 84/165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:18 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:18.608503 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 82/166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:18 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:19.379768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:19.380323 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:19.386244 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:19.386717 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:19.387137 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:19.387810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:19.388337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:19.388779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:19.405723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-002ce731-60d6-42c3-9c56-4623984da395 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:19.406322 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-002ce731-60d6-42c3-9c56-4623984da395 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:19.412299 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-002ce731-60d6-42c3-9c56-4623984da395 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:19.412777 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-002ce731-60d6-42c3-9c56-4623984da395 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:19.413199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-002ce731-60d6-42c3-9c56-4623984da395 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:19.413883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-002ce731-60d6-42c3-9c56-4623984da395 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:19.414325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-002ce731-60d6-42c3-9c56-4623984da395 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:19.414742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-002ce731-60d6-42c3-9c56-4623984da395 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:19.535025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:19.543984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:19.545605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:19.546787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bc2464b9-d29a-41cf-a419-f39b2cd4ef92 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.171706 Aug 30 01:56:19.547600 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 85/167] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:19 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:19.590549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-002ce731-60d6-42c3-9c56-4623984da395 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:19.600512 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-002ce731-60d6-42c3-9c56-4623984da395 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.198390 Aug 30 01:56:19.601795 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 83/168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:19 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:19.630219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9b387df4-c477-4b72-a9c4-b3f6887fd622 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:19.630746 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9b387df4-c477-4b72-a9c4-b3f6887fd622 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:19.638135 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0ddb8a45-e044-448c-b07b-c52553f599f4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:19.638734 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0ddb8a45-e044-448c-b07b-c52553f599f4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:19.645237 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b387df4-c477-4b72-a9c4-b3f6887fd622 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:19.645833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b387df4-c477-4b72-a9c4-b3f6887fd622 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:19.648008 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b387df4-c477-4b72-a9c4-b3f6887fd622 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:19.649073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b387df4-c477-4b72-a9c4-b3f6887fd622 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:19.651245 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ddb8a45-e044-448c-b07b-c52553f599f4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:19.651747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ddb8a45-e044-448c-b07b-c52553f599f4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:19.652389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b387df4-c477-4b72-a9c4-b3f6887fd622 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:19.652916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b387df4-c477-4b72-a9c4-b3f6887fd622 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:19.655900 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ddb8a45-e044-448c-b07b-c52553f599f4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:19.656762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ddb8a45-e044-448c-b07b-c52553f599f4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:19.659847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ddb8a45-e044-448c-b07b-c52553f599f4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:19.660307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0ddb8a45-e044-448c-b07b-c52553f599f4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:19.865932 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0ddb8a45-e044-448c-b07b-c52553f599f4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:19.876216 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9b387df4-c477-4b72-a9c4-b3f6887fd622 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:19.879098 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0ddb8a45-e044-448c-b07b-c52553f599f4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.244550 Aug 30 01:56:19.879669 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 84/169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:19 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:19.884737 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9b387df4-c477-4b72-a9c4-b3f6887fd622 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.259478 Aug 30 01:56:19.885225 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 86/170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:19 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:20.575424 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:20.576886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:20.586421 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:20.587372 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:20.588173 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:20.589408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:20.590157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:20.591054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:20.622166 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-58cfa929-564f-4cdb-8892-6466f4b06955 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:20.623667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-58cfa929-564f-4cdb-8892-6466f4b06955 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:20.634773 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58cfa929-564f-4cdb-8892-6466f4b06955 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:20.636217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58cfa929-564f-4cdb-8892-6466f4b06955 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:20.637909 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58cfa929-564f-4cdb-8892-6466f4b06955 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:20.638956 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58cfa929-564f-4cdb-8892-6466f4b06955 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:20.640020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58cfa929-564f-4cdb-8892-6466f4b06955 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:20.640965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58cfa929-564f-4cdb-8892-6466f4b06955 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:21.047879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:21.057192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:21.060328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:21.063418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d49645ca-aa5f-4efe-b606-f8d690dc2833 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.494719 Aug 30 01:56:21.081149 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 85/171] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:20 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:21.088795 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-14ca4ed1-0407-4cce-a278-539191c5e26b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:21.089840 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-14ca4ed1-0407-4cce-a278-539191c5e26b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:21.096967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:21.099660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14ca4ed1-0407-4cce-a278-539191c5e26b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:21.100533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14ca4ed1-0407-4cce-a278-539191c5e26b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:21.101727 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14ca4ed1-0407-4cce-a278-539191c5e26b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:21.102778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14ca4ed1-0407-4cce-a278-539191c5e26b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:21.103467 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14ca4ed1-0407-4cce-a278-539191c5e26b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:21.104101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14ca4ed1-0407-4cce-a278-539191c5e26b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:21.117383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-58cfa929-564f-4cdb-8892-6466f4b06955 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:21.131427 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-58cfa929-564f-4cdb-8892-6466f4b06955 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.513021 Aug 30 01:56:21.146061 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 87/172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:20 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:21.152803 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-74b811e5-3ef5-4c41-9c6d-c013fb520dc7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:21.154911 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-74b811e5-3ef5-4c41-9c6d-c013fb520dc7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:21.163011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74b811e5-3ef5-4c41-9c6d-c013fb520dc7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:21.163810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74b811e5-3ef5-4c41-9c6d-c013fb520dc7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:21.164581 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74b811e5-3ef5-4c41-9c6d-c013fb520dc7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:21.165553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74b811e5-3ef5-4c41-9c6d-c013fb520dc7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:21.166679 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74b811e5-3ef5-4c41-9c6d-c013fb520dc7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:21.167366 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-74b811e5-3ef5-4c41-9c6d-c013fb520dc7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:21.196848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:21.571875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-74b811e5-3ef5-4c41-9c6d-c013fb520dc7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:21.580281 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-74b811e5-3ef5-4c41-9c6d-c013fb520dc7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.432460 Aug 30 01:56:21.592304 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 88/173] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:21 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:21.641382 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-14ca4ed1-0407-4cce-a278-539191c5e26b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:21.656886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-14ca4ed1-0407-4cce-a278-539191c5e26b tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.574064 Aug 30 01:56:21.657508 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 86/174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:21 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:21.748338 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-14edd7f4-826d-474c-9b67-b5dfa9e2b162 req-f2f69563-36e4-4e92-8f72-dcbeb157dcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51036535-5cf5-4283-b501-b0809e3f57a6", "name": "network-vif-plugged", "status": "completed", "tag": "b76470f7-925f-4c0c-b128-d7b4fbc6e636"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:21.757980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-14edd7f4-826d-474c-9b67-b5dfa9e2b162 req-f2f69563-36e4-4e92-8f72-dcbeb157dcfd service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:21.758402 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-14edd7f4-826d-474c-9b67-b5dfa9e2b162 req-f2f69563-36e4-4e92-8f72-dcbeb157dcfd service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:21.758839 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-14edd7f4-826d-474c-9b67-b5dfa9e2b162 req-f2f69563-36e4-4e92-8f72-dcbeb157dcfd service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:21.769884 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-14edd7f4-826d-474c-9b67-b5dfa9e2b162 req-f2f69563-36e4-4e92-8f72-dcbeb157dcfd service nova] Creating event network-vif-plugged:b76470f7-925f-4c0c-b128-d7b4fbc6e636 for instance 51036535-5cf5-4283-b501-b0809e3f57a6 on hv-cinder-81966 Aug 30 01:56:21.774865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-14edd7f4-826d-474c-9b67-b5dfa9e2b162 req-f2f69563-36e4-4e92-8f72-dcbeb157dcfd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079979 Aug 30 01:56:21.775457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 89/175] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:56:22.086462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:22.087066 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:22.093514 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:22.093996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:22.094421 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:22.095105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:22.095554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:22.095971 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:22.153975 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cb4af80f-ef66-409c-9ff9-f3ea7d879d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:22.154930 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cb4af80f-ef66-409c-9ff9-f3ea7d879d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:22.160454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:22.172905 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb4af80f-ef66-409c-9ff9-f3ea7d879d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:22.173961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb4af80f-ef66-409c-9ff9-f3ea7d879d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:22.174394 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb4af80f-ef66-409c-9ff9-f3ea7d879d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:22.175086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb4af80f-ef66-409c-9ff9-f3ea7d879d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:22.175523 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb4af80f-ef66-409c-9ff9-f3ea7d879d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:22.175940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb4af80f-ef66-409c-9ff9-f3ea7d879d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:22.292838 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:22.306935 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:22.308515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:22.309724 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-72cbd5c7-51e9-4127-9e50-92ecf249b38f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.227475 Aug 30 01:56:22.310440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 87/176] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:22 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:22.343920 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cb4af80f-ef66-409c-9ff9-f3ea7d879d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:22.351901 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cb4af80f-ef66-409c-9ff9-f3ea7d879d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.202334 Aug 30 01:56:22.352486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 90/177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:22 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:22.602757 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9b85acfa-1284-47cf-a1a9-475ca6291ed9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:22.603281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9b85acfa-1284-47cf-a1a9-475ca6291ed9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:22.609086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b85acfa-1284-47cf-a1a9-475ca6291ed9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:22.609553 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b85acfa-1284-47cf-a1a9-475ca6291ed9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:22.610017 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b85acfa-1284-47cf-a1a9-475ca6291ed9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:22.610705 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b85acfa-1284-47cf-a1a9-475ca6291ed9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:22.611187 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b85acfa-1284-47cf-a1a9-475ca6291ed9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:22.611600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b85acfa-1284-47cf-a1a9-475ca6291ed9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:22.683798 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-18cd8e88-503c-40c9-b741-4ff47362a461 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:22.684546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-18cd8e88-503c-40c9-b741-4ff47362a461 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:22.690601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18cd8e88-503c-40c9-b741-4ff47362a461 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:22.691169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18cd8e88-503c-40c9-b741-4ff47362a461 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:22.691783 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18cd8e88-503c-40c9-b741-4ff47362a461 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:22.692678 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18cd8e88-503c-40c9-b741-4ff47362a461 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:22.693305 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18cd8e88-503c-40c9-b741-4ff47362a461 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:22.693914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18cd8e88-503c-40c9-b741-4ff47362a461 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:22.758421 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9b85acfa-1284-47cf-a1a9-475ca6291ed9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:22.766950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9b85acfa-1284-47cf-a1a9-475ca6291ed9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.167778 Aug 30 01:56:22.767989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 88/178] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:22 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:22.823676 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-18cd8e88-503c-40c9-b741-4ff47362a461 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:22.831799 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-18cd8e88-503c-40c9-b741-4ff47362a461 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.157915 Aug 30 01:56:22.834888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 91/179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:22 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:23.331500 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:23.332052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:23.338310 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:23.338818 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:23.339243 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:23.339979 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:23.340471 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:23.340897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:23.386018 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-11fbf403-e5ad-4679-b729-b943b3522a1c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:23.386633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-11fbf403-e5ad-4679-b729-b943b3522a1c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:23.409097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11fbf403-e5ad-4679-b729-b943b3522a1c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:23.409591 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11fbf403-e5ad-4679-b729-b943b3522a1c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:23.410024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11fbf403-e5ad-4679-b729-b943b3522a1c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:23.410726 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11fbf403-e5ad-4679-b729-b943b3522a1c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:23.411195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11fbf403-e5ad-4679-b729-b943b3522a1c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:23.411620 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11fbf403-e5ad-4679-b729-b943b3522a1c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:23.513697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:23.522118 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:23.523559 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:23.524721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0072ab74-fe0a-474d-9fd8-7b72f452121f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.197314 Aug 30 01:56:23.525283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 89/180] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:23 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:23.568073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-11fbf403-e5ad-4679-b729-b943b3522a1c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:23.575581 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-11fbf403-e5ad-4679-b729-b943b3522a1c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.206337 Aug 30 01:56:23.576136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 92/181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:23 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:23.788716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e163d640-827d-483d-81ba-194758a547bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:23.789362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e163d640-827d-483d-81ba-194758a547bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:23.795258 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e163d640-827d-483d-81ba-194758a547bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:23.795742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e163d640-827d-483d-81ba-194758a547bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:23.796171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e163d640-827d-483d-81ba-194758a547bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:23.796878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e163d640-827d-483d-81ba-194758a547bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:23.797331 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e163d640-827d-483d-81ba-194758a547bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:23.797750 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e163d640-827d-483d-81ba-194758a547bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:23.802343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:23.860458 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-98c196d3-eff0-4b88-8183-3de72b9945a6 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:23.860458 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-98c196d3-eff0-4b88-8183-3de72b9945a6 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:23.867279 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98c196d3-eff0-4b88-8183-3de72b9945a6 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:23.868832 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98c196d3-eff0-4b88-8183-3de72b9945a6 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:23.869513 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98c196d3-eff0-4b88-8183-3de72b9945a6 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:23.870447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98c196d3-eff0-4b88-8183-3de72b9945a6 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:23.870908 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98c196d3-eff0-4b88-8183-3de72b9945a6 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:23.872228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98c196d3-eff0-4b88-8183-3de72b9945a6 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:23.958041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e163d640-827d-483d-81ba-194758a547bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:23.973407 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e163d640-827d-483d-81ba-194758a547bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.188365 Aug 30 01:56:23.974312 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 90/182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:23 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:24.028481 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-98c196d3-eff0-4b88-8183-3de72b9945a6 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:24.036711 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-98c196d3-eff0-4b88-8183-3de72b9945a6 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.188158 Aug 30 01:56:24.037287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 93/183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:23 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:24.547927 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:24.548552 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:24.554273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:24.554746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:24.555170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:24.555845 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:24.556311 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:24.556727 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:24.596094 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0f85a6a8-bfe7-4187-b393-0fa2ebab53d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:24.596887 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0f85a6a8-bfe7-4187-b393-0fa2ebab53d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:24.604202 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f85a6a8-bfe7-4187-b393-0fa2ebab53d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:24.604895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f85a6a8-bfe7-4187-b393-0fa2ebab53d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:24.605425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f85a6a8-bfe7-4187-b393-0fa2ebab53d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:24.606223 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f85a6a8-bfe7-4187-b393-0fa2ebab53d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:24.606984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f85a6a8-bfe7-4187-b393-0fa2ebab53d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:24.607543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f85a6a8-bfe7-4187-b393-0fa2ebab53d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:24.714000 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:24.724416 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:24.726138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:24.727728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6e07be30-28e2-4faf-b03f-6fc1cbcb18a6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.183613 Aug 30 01:56:24.732039 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 91/184] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:24 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:24.783413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0f85a6a8-bfe7-4187-b393-0fa2ebab53d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:24.792333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0f85a6a8-bfe7-4187-b393-0fa2ebab53d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.199946 Aug 30 01:56:24.792906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 94/185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:24 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:24.997531 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-61590736-303d-4485-99ac-a621f866a538 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:24.999209 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-61590736-303d-4485-99ac-a621f866a538 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:25.008847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-61590736-303d-4485-99ac-a621f866a538 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:25.009794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-61590736-303d-4485-99ac-a621f866a538 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:25.010532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-61590736-303d-4485-99ac-a621f866a538 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:25.011927 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-61590736-303d-4485-99ac-a621f866a538 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:25.012628 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-61590736-303d-4485-99ac-a621f866a538 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:25.013263 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-61590736-303d-4485-99ac-a621f866a538 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:25.057773 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d3d44492-fd9f-480b-8aa1-55827c8eb8ab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:25.058426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d3d44492-fd9f-480b-8aa1-55827c8eb8ab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:25.066476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3d44492-fd9f-480b-8aa1-55827c8eb8ab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:25.066968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3d44492-fd9f-480b-8aa1-55827c8eb8ab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:25.067409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3d44492-fd9f-480b-8aa1-55827c8eb8ab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:25.068118 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3d44492-fd9f-480b-8aa1-55827c8eb8ab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:25.068816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3d44492-fd9f-480b-8aa1-55827c8eb8ab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:25.079243 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d3d44492-fd9f-480b-8aa1-55827c8eb8ab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:25.261836 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-61590736-303d-4485-99ac-a621f866a538 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:25.267350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d3d44492-fd9f-480b-8aa1-55827c8eb8ab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:25.271929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-61590736-303d-4485-99ac-a621f866a538 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.277808 Aug 30 01:56:25.272769 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 92/186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:24 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:25.277092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d3d44492-fd9f-480b-8aa1-55827c8eb8ab tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.223487 Aug 30 01:56:25.277748 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 95/187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:25 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:25.754432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:25.755040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:25.761431 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:25.761878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:25.762454 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:25.763152 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:25.763606 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:25.764031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:25.815882 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7ff964f1-a859-49dc-8688-f5a0b8bf00bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:25.816873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7ff964f1-a859-49dc-8688-f5a0b8bf00bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:25.824856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ff964f1-a859-49dc-8688-f5a0b8bf00bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:25.825337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ff964f1-a859-49dc-8688-f5a0b8bf00bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:25.825798 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ff964f1-a859-49dc-8688-f5a0b8bf00bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:25.826493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ff964f1-a859-49dc-8688-f5a0b8bf00bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:25.827190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ff964f1-a859-49dc-8688-f5a0b8bf00bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:25.827805 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ff964f1-a859-49dc-8688-f5a0b8bf00bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:25.929280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:25.937774 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:25.939881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:25.941019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-fb36bfc9-4d1c-46cf-bd70-8db680f2520b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.190780 Aug 30 01:56:25.941751 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 93/188] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:25 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:26.034402 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7ff964f1-a859-49dc-8688-f5a0b8bf00bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:26.042908 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7ff964f1-a859-49dc-8688-f5a0b8bf00bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.231789 Aug 30 01:56:26.044290 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 96/189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:25 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:26.298088 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9e7213eb-7069-4267-a740-7a839c6cba64 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:26.299459 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9e7213eb-7069-4267-a740-7a839c6cba64 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:26.304441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bcd2dbcb-390d-4310-b982-17c6c150ecba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:26.305052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bcd2dbcb-390d-4310-b982-17c6c150ecba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:26.317817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcd2dbcb-390d-4310-b982-17c6c150ecba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:26.319570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e7213eb-7069-4267-a740-7a839c6cba64 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:26.319818 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcd2dbcb-390d-4310-b982-17c6c150ecba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:26.320988 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcd2dbcb-390d-4310-b982-17c6c150ecba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:26.321680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e7213eb-7069-4267-a740-7a839c6cba64 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:26.322701 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcd2dbcb-390d-4310-b982-17c6c150ecba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:26.323347 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e7213eb-7069-4267-a740-7a839c6cba64 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:26.324012 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcd2dbcb-390d-4310-b982-17c6c150ecba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:26.324903 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e7213eb-7069-4267-a740-7a839c6cba64 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:26.327124 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcd2dbcb-390d-4310-b982-17c6c150ecba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:26.330014 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e7213eb-7069-4267-a740-7a839c6cba64 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:26.330588 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e7213eb-7069-4267-a740-7a839c6cba64 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:26.500568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9e7213eb-7069-4267-a740-7a839c6cba64 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:26.510161 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9e7213eb-7069-4267-a740-7a839c6cba64 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.215771 Aug 30 01:56:26.510730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 97/190] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:26 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:26.726581 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-bcd2dbcb-390d-4310-b982-17c6c150ecba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:26.735491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bcd2dbcb-390d-4310-b982-17c6c150ecba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.442103 Aug 30 01:56:26.736094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 94/191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:26 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:26.968603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:26.969913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:27.002350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:27.006517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:27.007386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:27.008732 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:27.009402 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:27.014892 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:27.065186 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f7b593ce-435c-489e-b7ac-f8145238e556 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:27.066082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f7b593ce-435c-489e-b7ac-f8145238e556 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:27.078722 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7b593ce-435c-489e-b7ac-f8145238e556 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:27.080349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7b593ce-435c-489e-b7ac-f8145238e556 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:27.082254 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7b593ce-435c-489e-b7ac-f8145238e556 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:27.083652 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7b593ce-435c-489e-b7ac-f8145238e556 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:27.086155 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7b593ce-435c-489e-b7ac-f8145238e556 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:27.087146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7b593ce-435c-489e-b7ac-f8145238e556 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:27.255131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:27.266299 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:27.277064 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:27.278209 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6b7aeb59-2fe4-4412-90ce-6137f62d945c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.317198 Aug 30 01:56:27.278761 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 98/192] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:26 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:56:27.374280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f7b593ce-435c-489e-b7ac-f8145238e556 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:27.387846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f7b593ce-435c-489e-b7ac-f8145238e556 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.327732 Aug 30 01:56:27.388769 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 95/193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:27 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:27.534360 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fda23361-fe81-4896-953d-f85192a9e708 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:27.535083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fda23361-fe81-4896-953d-f85192a9e708 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:27.543625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda23361-fe81-4896-953d-f85192a9e708 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:27.544871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda23361-fe81-4896-953d-f85192a9e708 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:27.545816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda23361-fe81-4896-953d-f85192a9e708 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:27.546667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda23361-fe81-4896-953d-f85192a9e708 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:27.547316 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda23361-fe81-4896-953d-f85192a9e708 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:27.547736 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda23361-fe81-4896-953d-f85192a9e708 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:27.757039 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0c19a8a7-28ae-4f38-9203-6cdf77970fe7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:27.757812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0c19a8a7-28ae-4f38-9203-6cdf77970fe7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:27.780329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0c19a8a7-28ae-4f38-9203-6cdf77970fe7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:27.783076 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0c19a8a7-28ae-4f38-9203-6cdf77970fe7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:27.783703 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0c19a8a7-28ae-4f38-9203-6cdf77970fe7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:27.786495 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0c19a8a7-28ae-4f38-9203-6cdf77970fe7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:27.788363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0c19a8a7-28ae-4f38-9203-6cdf77970fe7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:27.788976 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0c19a8a7-28ae-4f38-9203-6cdf77970fe7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:27.794791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fda23361-fe81-4896-953d-f85192a9e708 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:27.805028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fda23361-fe81-4896-953d-f85192a9e708 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.276566 Aug 30 01:56:27.805973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 99/194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:27 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:28.017240 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0c19a8a7-28ae-4f38-9203-6cdf77970fe7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:28.029857 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0c19a8a7-28ae-4f38-9203-6cdf77970fe7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.276492 Aug 30 01:56:28.047182 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 96/195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:27 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:28.305496 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:28.306115 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:28.313227 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:28.313791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:28.314760 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:28.315462 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:28.316228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:28.316827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:28.410069 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-631f8ab7-0bc6-4b7b-a49c-8dae31aef2b6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:28.410809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-631f8ab7-0bc6-4b7b-a49c-8dae31aef2b6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:28.417106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-631f8ab7-0bc6-4b7b-a49c-8dae31aef2b6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:28.417835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-631f8ab7-0bc6-4b7b-a49c-8dae31aef2b6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:28.418488 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-631f8ab7-0bc6-4b7b-a49c-8dae31aef2b6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:28.419379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-631f8ab7-0bc6-4b7b-a49c-8dae31aef2b6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:28.420145 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-631f8ab7-0bc6-4b7b-a49c-8dae31aef2b6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:28.420823 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-631f8ab7-0bc6-4b7b-a49c-8dae31aef2b6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:28.496694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:28.506232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:28.507708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:28.508843 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d65ef04f-26be-4662-bf17-b0efdd55c4cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.207888 Aug 30 01:56:28.509632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 100/196] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:28 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:28.598961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-631f8ab7-0bc6-4b7b-a49c-8dae31aef2b6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:28.607788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-631f8ab7-0bc6-4b7b-a49c-8dae31aef2b6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.202047 Aug 30 01:56:28.608475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 97/197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:28 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:28.826243 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-85c3bf48-a721-458c-808d-325bf6c4ad23 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:28.826906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-85c3bf48-a721-458c-808d-325bf6c4ad23 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:28.837232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c3bf48-a721-458c-808d-325bf6c4ad23 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:28.837716 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c3bf48-a721-458c-808d-325bf6c4ad23 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:28.838142 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c3bf48-a721-458c-808d-325bf6c4ad23 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:28.838825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c3bf48-a721-458c-808d-325bf6c4ad23 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:28.839267 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c3bf48-a721-458c-808d-325bf6c4ad23 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:28.839682 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85c3bf48-a721-458c-808d-325bf6c4ad23 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:29.004973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-85c3bf48-a721-458c-808d-325bf6c4ad23 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:29.012599 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-85c3bf48-a721-458c-808d-325bf6c4ad23 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.190052 Aug 30 01:56:29.013287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 101/198] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:28 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:29.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b9af7e82-83e8-4343-be7a-b5892ce3a1c3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:29.055350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b9af7e82-83e8-4343-be7a-b5892ce3a1c3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:29.061340 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9af7e82-83e8-4343-be7a-b5892ce3a1c3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:29.061756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9af7e82-83e8-4343-be7a-b5892ce3a1c3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:29.062181 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9af7e82-83e8-4343-be7a-b5892ce3a1c3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:29.062855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9af7e82-83e8-4343-be7a-b5892ce3a1c3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:29.063300 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9af7e82-83e8-4343-be7a-b5892ce3a1c3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:29.063720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9af7e82-83e8-4343-be7a-b5892ce3a1c3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:29.213040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b9af7e82-83e8-4343-be7a-b5892ce3a1c3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:29.226695 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b9af7e82-83e8-4343-be7a-b5892ce3a1c3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.175491 Aug 30 01:56:29.242320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 98/199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:29 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:29.536645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:29.537355 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:29.544508 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:29.545427 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:29.545965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:29.546734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:29.547269 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:29.547757 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:29.629809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6c33022f-ea77-43f1-acec-e8a3e44fe211 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:29.630599 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6c33022f-ea77-43f1-acec-e8a3e44fe211 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:29.637175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6c33022f-ea77-43f1-acec-e8a3e44fe211 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:29.637663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6c33022f-ea77-43f1-acec-e8a3e44fe211 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:29.638125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6c33022f-ea77-43f1-acec-e8a3e44fe211 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:29.638836 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6c33022f-ea77-43f1-acec-e8a3e44fe211 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:29.639974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6c33022f-ea77-43f1-acec-e8a3e44fe211 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:29.640616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6c33022f-ea77-43f1-acec-e8a3e44fe211 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:29.700370 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:29.712408 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:29.713978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:29.716133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2ad50037-abf9-41a6-8956-0e09701ea993 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.183846 Aug 30 01:56:29.723059 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 102/200] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:29 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:29.731976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-0af56c9f-56a3-464d-ab18-fc601a1fc9b8 req-84a3adbe-022b-40d0-9384-c446c777e39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc020eb2-3c25-4134-a4c7-509b49c21851", "name": "network-vif-plugged", "status": "completed", "tag": "5a4eae3d-bb7e-4af7-bd34-515aa4be72ed"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:29.745938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0af56c9f-56a3-464d-ab18-fc601a1fc9b8 req-84a3adbe-022b-40d0-9384-c446c777e39e service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:29.746412 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0af56c9f-56a3-464d-ab18-fc601a1fc9b8 req-84a3adbe-022b-40d0-9384-c446c777e39e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:29.746869 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0af56c9f-56a3-464d-ab18-fc601a1fc9b8 req-84a3adbe-022b-40d0-9384-c446c777e39e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:29.760030 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-0af56c9f-56a3-464d-ab18-fc601a1fc9b8 req-84a3adbe-022b-40d0-9384-c446c777e39e service nova] Creating event network-vif-plugged:5a4eae3d-bb7e-4af7-bd34-515aa4be72ed for instance fc020eb2-3c25-4134-a4c7-509b49c21851 on hv-cinder-81966 Aug 30 01:56:29.766260 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-0af56c9f-56a3-464d-ab18-fc601a1fc9b8 req-84a3adbe-022b-40d0-9384-c446c777e39e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041334 Aug 30 01:56:29.767083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 103/201] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:56:29.808666 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6c33022f-ea77-43f1-acec-e8a3e44fe211 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:29.816639 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6c33022f-ea77-43f1-acec-e8a3e44fe211 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.191740 Aug 30 01:56:29.817198 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 99/202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:29 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:30.036276 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6045392c-54ca-4f29-81fd-324d91b3fefb tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:30.037504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6045392c-54ca-4f29-81fd-324d91b3fefb tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:30.045293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6045392c-54ca-4f29-81fd-324d91b3fefb tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:30.046018 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6045392c-54ca-4f29-81fd-324d91b3fefb tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:30.046674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6045392c-54ca-4f29-81fd-324d91b3fefb tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:30.047436 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6045392c-54ca-4f29-81fd-324d91b3fefb tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:30.047950 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6045392c-54ca-4f29-81fd-324d91b3fefb tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:30.048497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6045392c-54ca-4f29-81fd-324d91b3fefb tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:30.212032 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6045392c-54ca-4f29-81fd-324d91b3fefb tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:30.220995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6045392c-54ca-4f29-81fd-324d91b3fefb tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.188695 Aug 30 01:56:30.221557 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 104/203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:30 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:30.246662 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-26dcf6b7-5d33-47c9-b4bf-93d2907d09ed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:30.247263 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-26dcf6b7-5d33-47c9-b4bf-93d2907d09ed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:30.253281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dcf6b7-5d33-47c9-b4bf-93d2907d09ed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:30.253754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dcf6b7-5d33-47c9-b4bf-93d2907d09ed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:30.254176 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dcf6b7-5d33-47c9-b4bf-93d2907d09ed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:30.254847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dcf6b7-5d33-47c9-b4bf-93d2907d09ed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:30.255288 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dcf6b7-5d33-47c9-b4bf-93d2907d09ed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:30.255701 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dcf6b7-5d33-47c9-b4bf-93d2907d09ed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:30.403773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-26dcf6b7-5d33-47c9-b4bf-93d2907d09ed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:30.413343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-26dcf6b7-5d33-47c9-b4bf-93d2907d09ed tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.170335 Aug 30 01:56:30.413904 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 100/204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:30 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:30.740158 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:30.743060 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:30.755881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:30.756403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:30.756834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:30.757525 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:30.757979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:30.758400 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:30.838137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-37d50090-6565-42b5-9a91-963f91da13dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:30.838913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-37d50090-6565-42b5-9a91-963f91da13dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:30.845227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37d50090-6565-42b5-9a91-963f91da13dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:30.845724 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37d50090-6565-42b5-9a91-963f91da13dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:30.846149 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37d50090-6565-42b5-9a91-963f91da13dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:30.846846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37d50090-6565-42b5-9a91-963f91da13dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:30.847291 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37d50090-6565-42b5-9a91-963f91da13dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:30.847709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37d50090-6565-42b5-9a91-963f91da13dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:30.985013 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-37d50090-6565-42b5-9a91-963f91da13dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:30.992876 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-37d50090-6565-42b5-9a91-963f91da13dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.159758 Aug 30 01:56:30.993465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 101/205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:30 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:31.077409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:31.085934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:31.087406 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:31.088523 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-df3f9862-c992-425e-aff5-0cd824ebbbbc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1405 microversion: 2.20 time: 0.352714 Aug 30 01:56:31.089075 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 105/206] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:30 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1405 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:31.241744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9a83ccf4-377c-4dfd-a037-6d0eb9495f75 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:31.242368 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9a83ccf4-377c-4dfd-a037-6d0eb9495f75 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:31.249189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a83ccf4-377c-4dfd-a037-6d0eb9495f75 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:31.249685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a83ccf4-377c-4dfd-a037-6d0eb9495f75 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:31.250119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a83ccf4-377c-4dfd-a037-6d0eb9495f75 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:31.250815 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a83ccf4-377c-4dfd-a037-6d0eb9495f75 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:31.252002 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a83ccf4-377c-4dfd-a037-6d0eb9495f75 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:31.252698 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a83ccf4-377c-4dfd-a037-6d0eb9495f75 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:31.404810 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9a83ccf4-377c-4dfd-a037-6d0eb9495f75 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:31.414806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9a83ccf4-377c-4dfd-a037-6d0eb9495f75 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.176765 Aug 30 01:56:31.428221 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 102/207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:31 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:31.434764 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-df2665bb-d343-4814-bc9b-8bd21ff80c8c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:31.435369 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-df2665bb-d343-4814-bc9b-8bd21ff80c8c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:31.445475 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df2665bb-d343-4814-bc9b-8bd21ff80c8c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:31.446977 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df2665bb-d343-4814-bc9b-8bd21ff80c8c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:31.448357 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df2665bb-d343-4814-bc9b-8bd21ff80c8c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:31.449567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df2665bb-d343-4814-bc9b-8bd21ff80c8c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:31.450369 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df2665bb-d343-4814-bc9b-8bd21ff80c8c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:31.451144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df2665bb-d343-4814-bc9b-8bd21ff80c8c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:31.474713 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:31.644617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-df2665bb-d343-4814-bc9b-8bd21ff80c8c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:31.652743 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-df2665bb-d343-4814-bc9b-8bd21ff80c8c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.221567 Aug 30 01:56:31.653337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 106/208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:31 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:31.800511 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-9be71b12-e862-455e-aa6a-c61920678db3 req-daf39f0c-bbdb-4dde-918a-aa7d27a0f718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f76949-51c7-4027-bca6-70e517d28eec", "name": "network-vif-plugged", "status": "completed", "tag": "33449dfd-7aea-47a8-bf04-2dbf480241dd"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:31.809960 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9be71b12-e862-455e-aa6a-c61920678db3 req-daf39f0c-bbdb-4dde-918a-aa7d27a0f718 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:31.810440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9be71b12-e862-455e-aa6a-c61920678db3 req-daf39f0c-bbdb-4dde-918a-aa7d27a0f718 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:31.810874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9be71b12-e862-455e-aa6a-c61920678db3 req-daf39f0c-bbdb-4dde-918a-aa7d27a0f718 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:31.823469 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-9be71b12-e862-455e-aa6a-c61920678db3 req-daf39f0c-bbdb-4dde-918a-aa7d27a0f718 service nova] Creating event network-vif-plugged:33449dfd-7aea-47a8-bf04-2dbf480241dd for instance 22f76949-51c7-4027-bca6-70e517d28eec on hv-cinder-81966 Aug 30 01:56:31.828304 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-9be71b12-e862-455e-aa6a-c61920678db3 req-daf39f0c-bbdb-4dde-918a-aa7d27a0f718 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031683 Aug 30 01:56:31.828908 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 103/209] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:56:32.013708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9a7e32ad-c279-460c-943e-30e0baed9d20 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:32.014625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9a7e32ad-c279-460c-943e-30e0baed9d20 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:32.023448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a7e32ad-c279-460c-943e-30e0baed9d20 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:32.024194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a7e32ad-c279-460c-943e-30e0baed9d20 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:32.024841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a7e32ad-c279-460c-943e-30e0baed9d20 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:32.025925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a7e32ad-c279-460c-943e-30e0baed9d20 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:32.026582 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a7e32ad-c279-460c-943e-30e0baed9d20 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:32.027179 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a7e32ad-c279-460c-943e-30e0baed9d20 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:32.112856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:32.113550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:32.122241 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:32.122751 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:32.123180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:32.124748 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:32.125199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:32.125621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:32.242171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9a7e32ad-c279-460c-943e-30e0baed9d20 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:32.254192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9a7e32ad-c279-460c-943e-30e0baed9d20 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.244320 Aug 30 01:56:32.255318 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 107/210] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:32 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:32.338235 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:32.347581 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:32.349144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:32.350319 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-478c9660-eec9-43bd-9f21-886f15b92b30 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1597 microversion: 2.20 time: 0.243068 Aug 30 01:56:32.350999 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 104/211] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:56:32 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1597 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:32.373904 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-29cd483e-9200-4107-bea9-f02b35f84d6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:32.374456 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-29cd483e-9200-4107-bea9-f02b35f84d6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:32.380902 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29cd483e-9200-4107-bea9-f02b35f84d6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:32.381560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29cd483e-9200-4107-bea9-f02b35f84d6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:32.382405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29cd483e-9200-4107-bea9-f02b35f84d6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:32.383157 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29cd483e-9200-4107-bea9-f02b35f84d6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:32.383609 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29cd483e-9200-4107-bea9-f02b35f84d6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:32.383997 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-29cd483e-9200-4107-bea9-f02b35f84d6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:32.435613 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-18628b52-53f8-4ed8-8d35-8d38c7a71e73 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:32.436490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-18628b52-53f8-4ed8-8d35-8d38c7a71e73 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:32.442635 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-18628b52-53f8-4ed8-8d35-8d38c7a71e73 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:32.443358 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-18628b52-53f8-4ed8-8d35-8d38c7a71e73 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:32.444005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-18628b52-53f8-4ed8-8d35-8d38c7a71e73 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:32.444951 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-18628b52-53f8-4ed8-8d35-8d38c7a71e73 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:32.445606 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-18628b52-53f8-4ed8-8d35-8d38c7a71e73 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:32.446247 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-18628b52-53f8-4ed8-8d35-8d38c7a71e73 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:32.554650 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-29cd483e-9200-4107-bea9-f02b35f84d6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.184972 Aug 30 01:56:32.558217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 108/212] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 30 01:56:32 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:56:32.596563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-18628b52-53f8-4ed8-8d35-8d38c7a71e73 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:32.616534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-18628b52-53f8-4ed8-8d35-8d38c7a71e73 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1314 microversion: 2.1 time: 0.185029 Aug 30 01:56:32.617105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 105/213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:32 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:32.675562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c53df9a1-3702-4907-b7cb-2ed7f062e8ea tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:32.676475 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c53df9a1-3702-4907-b7cb-2ed7f062e8ea tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:32.693004 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c53df9a1-3702-4907-b7cb-2ed7f062e8ea tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:32.693575 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c53df9a1-3702-4907-b7cb-2ed7f062e8ea tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:32.694014 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c53df9a1-3702-4907-b7cb-2ed7f062e8ea tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:32.694773 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c53df9a1-3702-4907-b7cb-2ed7f062e8ea tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:32.695226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c53df9a1-3702-4907-b7cb-2ed7f062e8ea tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:32.695648 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c53df9a1-3702-4907-b7cb-2ed7f062e8ea tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:33.009298 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c53df9a1-3702-4907-b7cb-2ed7f062e8ea tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:33.018033 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c53df9a1-3702-4907-b7cb-2ed7f062e8ea tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.346313 Aug 30 01:56:33.018603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 109/214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:32 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:33.278458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-41a0f0a4-cff0-4ebb-ac09-d14705871c72 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:33.279204 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-41a0f0a4-cff0-4ebb-ac09-d14705871c72 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:33.287146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41a0f0a4-cff0-4ebb-ac09-d14705871c72 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:33.288344 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41a0f0a4-cff0-4ebb-ac09-d14705871c72 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:33.289112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41a0f0a4-cff0-4ebb-ac09-d14705871c72 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:33.292505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41a0f0a4-cff0-4ebb-ac09-d14705871c72 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:33.293362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41a0f0a4-cff0-4ebb-ac09-d14705871c72 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:33.294044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41a0f0a4-cff0-4ebb-ac09-d14705871c72 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:33.562089 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-41a0f0a4-cff0-4ebb-ac09-d14705871c72 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:33.580731 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-41a0f0a4-cff0-4ebb-ac09-d14705871c72 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.307015 Aug 30 01:56:33.597099 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 106/215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:33 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:33.639099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-345109fe-bc75-4286-853d-598e3b61d337 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:33.639099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-345109fe-bc75-4286-853d-598e3b61d337 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:33.648460 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-345109fe-bc75-4286-853d-598e3b61d337 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:33.648954 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-345109fe-bc75-4286-853d-598e3b61d337 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:33.649387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-345109fe-bc75-4286-853d-598e3b61d337 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:33.650092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-345109fe-bc75-4286-853d-598e3b61d337 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:33.650543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-345109fe-bc75-4286-853d-598e3b61d337 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:33.650963 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-345109fe-bc75-4286-853d-598e3b61d337 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:34.039342 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1c5a1805-9a5a-438d-bc9d-52bac885afdf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:34.040042 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1c5a1805-9a5a-438d-bc9d-52bac885afdf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:34.050945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c5a1805-9a5a-438d-bc9d-52bac885afdf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:34.051629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c5a1805-9a5a-438d-bc9d-52bac885afdf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:34.052222 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c5a1805-9a5a-438d-bc9d-52bac885afdf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:34.053307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c5a1805-9a5a-438d-bc9d-52bac885afdf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:34.053910 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c5a1805-9a5a-438d-bc9d-52bac885afdf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:34.054516 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c5a1805-9a5a-438d-bc9d-52bac885afdf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:34.080453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:34.210566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-345109fe-bc75-4286-853d-598e3b61d337 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:34.218473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-345109fe-bc75-4286-853d-598e3b61d337 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1502 microversion: 2.1 time: 0.584579 Aug 30 01:56:34.222263 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 110/216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:33 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1502 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:34.348788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1c5a1805-9a5a-438d-bc9d-52bac885afdf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:34.365127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1c5a1805-9a5a-438d-bc9d-52bac885afdf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.328877 Aug 30 01:56:34.370291 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 107/217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:34 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:34.606892 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-966320de-d51a-42a5-b02a-211e77aee41a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:34.607676 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-966320de-d51a-42a5-b02a-211e77aee41a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:34.615393 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-966320de-d51a-42a5-b02a-211e77aee41a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:34.617197 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-966320de-d51a-42a5-b02a-211e77aee41a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:34.618013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-966320de-d51a-42a5-b02a-211e77aee41a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:34.619227 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-966320de-d51a-42a5-b02a-211e77aee41a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:34.620436 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-966320de-d51a-42a5-b02a-211e77aee41a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:34.621044 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-966320de-d51a-42a5-b02a-211e77aee41a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:34.873391 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-966320de-d51a-42a5-b02a-211e77aee41a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:34.889195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-966320de-d51a-42a5-b02a-211e77aee41a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.285730 Aug 30 01:56:34.891729 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 111/218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:34 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:34.933387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-ffba01f3-1b88-476f-9d51-a020cba96c7e req-3463a619-d5c2-4597-996e-a6a9b961de51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51036535-5cf5-4283-b501-b0809e3f57a6", "tag": "b76470f7-925f-4c0c-b128-d7b4fbc6e636"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:34.946911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-ffba01f3-1b88-476f-9d51-a020cba96c7e req-3463a619-d5c2-4597-996e-a6a9b961de51 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:34.947391 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-ffba01f3-1b88-476f-9d51-a020cba96c7e req-3463a619-d5c2-4597-996e-a6a9b961de51 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:34.947806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-ffba01f3-1b88-476f-9d51-a020cba96c7e req-3463a619-d5c2-4597-996e-a6a9b961de51 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:34.964863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-ffba01f3-1b88-476f-9d51-a020cba96c7e req-3463a619-d5c2-4597-996e-a6a9b961de51 service nova] Creating event network-changed:b76470f7-925f-4c0c-b128-d7b4fbc6e636 for instance 51036535-5cf5-4283-b501-b0809e3f57a6 on hv-cinder-81966 Aug 30 01:56:34.972127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-ffba01f3-1b88-476f-9d51-a020cba96c7e req-3463a619-d5c2-4597-996e-a6a9b961de51 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043696 Aug 30 01:56:34.973490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 108/219] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:56:35.389677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-98071d94-9b4f-4574-b34f-a16fbf5fa322 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:35.390279 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-98071d94-9b4f-4574-b34f-a16fbf5fa322 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:35.396534 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98071d94-9b4f-4574-b34f-a16fbf5fa322 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:35.397324 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98071d94-9b4f-4574-b34f-a16fbf5fa322 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:35.398061 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98071d94-9b4f-4574-b34f-a16fbf5fa322 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:35.399546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98071d94-9b4f-4574-b34f-a16fbf5fa322 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:35.400194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98071d94-9b4f-4574-b34f-a16fbf5fa322 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:35.400831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98071d94-9b4f-4574-b34f-a16fbf5fa322 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:35.627996 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-98071d94-9b4f-4574-b34f-a16fbf5fa322 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:35.635910 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-98071d94-9b4f-4574-b34f-a16fbf5fa322 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.250050 Aug 30 01:56:35.637068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 112/220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:35 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:35.915102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f63c6033-8246-4e33-9952-40ac78c36e87 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:35.915812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f63c6033-8246-4e33-9952-40ac78c36e87 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:35.926761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f63c6033-8246-4e33-9952-40ac78c36e87 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:35.927247 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f63c6033-8246-4e33-9952-40ac78c36e87 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:35.927750 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f63c6033-8246-4e33-9952-40ac78c36e87 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:35.928814 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f63c6033-8246-4e33-9952-40ac78c36e87 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:35.929307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f63c6033-8246-4e33-9952-40ac78c36e87 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:35.929778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f63c6033-8246-4e33-9952-40ac78c36e87 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:36.094860 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f63c6033-8246-4e33-9952-40ac78c36e87 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:36.103864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f63c6033-8246-4e33-9952-40ac78c36e87 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.197851 Aug 30 01:56:36.113278 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 109/221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:35 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:36.657715 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dc62c176-7db3-42d4-a581-fd6e69ded6be tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:36.658452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dc62c176-7db3-42d4-a581-fd6e69ded6be tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:36.664770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc62c176-7db3-42d4-a581-fd6e69ded6be tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:36.665289 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc62c176-7db3-42d4-a581-fd6e69ded6be tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:36.665725 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc62c176-7db3-42d4-a581-fd6e69ded6be tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:36.666405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc62c176-7db3-42d4-a581-fd6e69ded6be tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:36.666844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc62c176-7db3-42d4-a581-fd6e69ded6be tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:36.667414 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc62c176-7db3-42d4-a581-fd6e69ded6be tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:36.826416 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dc62c176-7db3-42d4-a581-fd6e69ded6be tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:36.839994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dc62c176-7db3-42d4-a581-fd6e69ded6be tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.186565 Aug 30 01:56:36.840609 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 113/222] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:36 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:37.127975 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-256b2276-a18e-4f5e-b62e-3e6ce2c9f0c0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:37.129757 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-256b2276-a18e-4f5e-b62e-3e6ce2c9f0c0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:37.139803 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-256b2276-a18e-4f5e-b62e-3e6ce2c9f0c0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:37.140669 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-256b2276-a18e-4f5e-b62e-3e6ce2c9f0c0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:37.141415 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-256b2276-a18e-4f5e-b62e-3e6ce2c9f0c0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:37.152792 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-256b2276-a18e-4f5e-b62e-3e6ce2c9f0c0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:37.155012 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-256b2276-a18e-4f5e-b62e-3e6ce2c9f0c0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:37.155869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-256b2276-a18e-4f5e-b62e-3e6ce2c9f0c0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:37.360667 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-256b2276-a18e-4f5e-b62e-3e6ce2c9f0c0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:37.369570 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-256b2276-a18e-4f5e-b62e-3e6ce2c9f0c0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.247455 Aug 30 01:56:37.370141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 110/223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:37 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:37.861037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2a12307c-4134-45d0-bf90-6046d97bad7e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:37.861703 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2a12307c-4134-45d0-bf90-6046d97bad7e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:37.869233 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a12307c-4134-45d0-bf90-6046d97bad7e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:37.869718 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a12307c-4134-45d0-bf90-6046d97bad7e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:37.870149 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a12307c-4134-45d0-bf90-6046d97bad7e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:37.870860 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a12307c-4134-45d0-bf90-6046d97bad7e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:37.871332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a12307c-4134-45d0-bf90-6046d97bad7e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:37.871745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a12307c-4134-45d0-bf90-6046d97bad7e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:38.051876 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2a12307c-4134-45d0-bf90-6046d97bad7e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:38.062081 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2a12307c-4134-45d0-bf90-6046d97bad7e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.204913 Aug 30 01:56:38.062643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 114/224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:37 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:38.390651 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3191c12f-9aac-4098-a771-211d79625ae6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:38.391351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3191c12f-9aac-4098-a771-211d79625ae6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:38.397999 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3191c12f-9aac-4098-a771-211d79625ae6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:38.398551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3191c12f-9aac-4098-a771-211d79625ae6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:38.399048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3191c12f-9aac-4098-a771-211d79625ae6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:38.399796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3191c12f-9aac-4098-a771-211d79625ae6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:38.400337 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3191c12f-9aac-4098-a771-211d79625ae6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:38.400822 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3191c12f-9aac-4098-a771-211d79625ae6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:38.533212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3191c12f-9aac-4098-a771-211d79625ae6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:38.541118 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3191c12f-9aac-4098-a771-211d79625ae6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.154397 Aug 30 01:56:38.541683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 111/225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:38 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:39.085193 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d110b7ee-0fc4-4fbb-aaf8-1e19f780f989 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:39.085835 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d110b7ee-0fc4-4fbb-aaf8-1e19f780f989 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:39.092096 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d110b7ee-0fc4-4fbb-aaf8-1e19f780f989 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:39.092789 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d110b7ee-0fc4-4fbb-aaf8-1e19f780f989 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:39.093377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d110b7ee-0fc4-4fbb-aaf8-1e19f780f989 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:39.094110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d110b7ee-0fc4-4fbb-aaf8-1e19f780f989 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:39.094585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d110b7ee-0fc4-4fbb-aaf8-1e19f780f989 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:39.095041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d110b7ee-0fc4-4fbb-aaf8-1e19f780f989 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:39.241907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d110b7ee-0fc4-4fbb-aaf8-1e19f780f989 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:39.264181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d110b7ee-0fc4-4fbb-aaf8-1e19f780f989 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.182806 Aug 30 01:56:39.265049 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 115/226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:39 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:39.561667 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5886cc43-ad29-4a32-a51d-0354904640bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:39.563214 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5886cc43-ad29-4a32-a51d-0354904640bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:39.569389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5886cc43-ad29-4a32-a51d-0354904640bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:39.570075 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5886cc43-ad29-4a32-a51d-0354904640bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:39.570668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5886cc43-ad29-4a32-a51d-0354904640bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:39.571611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5886cc43-ad29-4a32-a51d-0354904640bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:39.572195 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5886cc43-ad29-4a32-a51d-0354904640bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:39.573146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5886cc43-ad29-4a32-a51d-0354904640bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:39.597802 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-bb135d49-092a-43f2-9d91-49874606439d req-4b1b2ffc-690f-4337-90e4-42b193180e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf13980-f99e-4a83-9ec5-95e80147696b", "name": "network-vif-plugged", "status": "completed", "tag": "73d5c135-a67f-4c18-bc03-d0162506c894"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:39.615756 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-bb135d49-092a-43f2-9d91-49874606439d req-4b1b2ffc-690f-4337-90e4-42b193180e0a service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:39.617081 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-bb135d49-092a-43f2-9d91-49874606439d req-4b1b2ffc-690f-4337-90e4-42b193180e0a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:39.618106 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-bb135d49-092a-43f2-9d91-49874606439d req-4b1b2ffc-690f-4337-90e4-42b193180e0a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:39.661342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-bb135d49-092a-43f2-9d91-49874606439d req-4b1b2ffc-690f-4337-90e4-42b193180e0a service nova] Creating event network-vif-plugged:73d5c135-a67f-4c18-bc03-d0162506c894 for instance 1cf13980-f99e-4a83-9ec5-95e80147696b on hv-cinder-81966 Aug 30 01:56:39.676479 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-bb135d49-092a-43f2-9d91-49874606439d req-4b1b2ffc-690f-4337-90e4-42b193180e0a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076781 Aug 30 01:56:39.677751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 116/227] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:56:39.841873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5886cc43-ad29-4a32-a51d-0354904640bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:39.850088 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5886cc43-ad29-4a32-a51d-0354904640bc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1367 microversion: 2.1 time: 0.293142 Aug 30 01:56:39.850647 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 112/228] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:39 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:40.098463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5066cf7d-443f-4163-aa45-4b23999efdb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "797c73cd-7a7e-4356-a995-24a9eb785233"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:40.100870 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5066cf7d-443f-4163-aa45-4b23999efdb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:40.107849 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5066cf7d-443f-4163-aa45-4b23999efdb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:40.108073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5066cf7d-443f-4163-aa45-4b23999efdb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:40.108530 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5066cf7d-443f-4163-aa45-4b23999efdb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:40.109212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5066cf7d-443f-4163-aa45-4b23999efdb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:40.109658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5066cf7d-443f-4163-aa45-4b23999efdb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:40.110075 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5066cf7d-443f-4163-aa45-4b23999efdb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:40.289239 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6991f672-ef6a-46a0-af0d-ad3dd01fbd6d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:40.289952 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6991f672-ef6a-46a0-af0d-ad3dd01fbd6d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:40.296202 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6991f672-ef6a-46a0-af0d-ad3dd01fbd6d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:40.296714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6991f672-ef6a-46a0-af0d-ad3dd01fbd6d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:40.297216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6991f672-ef6a-46a0-af0d-ad3dd01fbd6d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:40.297960 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6991f672-ef6a-46a0-af0d-ad3dd01fbd6d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:40.299054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6991f672-ef6a-46a0-af0d-ad3dd01fbd6d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:40.299536 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6991f672-ef6a-46a0-af0d-ad3dd01fbd6d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:40.432173 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6991f672-ef6a-46a0-af0d-ad3dd01fbd6d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:40.439708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6991f672-ef6a-46a0-af0d-ad3dd01fbd6d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.154294 Aug 30 01:56:40.440488 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 113/229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:40 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:40.869634 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2dc9068a-6c1a-41b9-a1ca-6b752d334749 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:40.870240 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2dc9068a-6c1a-41b9-a1ca-6b752d334749 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:40.875982 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2dc9068a-6c1a-41b9-a1ca-6b752d334749 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:40.876992 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2dc9068a-6c1a-41b9-a1ca-6b752d334749 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:40.877415 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2dc9068a-6c1a-41b9-a1ca-6b752d334749 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:40.878083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2dc9068a-6c1a-41b9-a1ca-6b752d334749 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:40.878523 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2dc9068a-6c1a-41b9-a1ca-6b752d334749 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:40.878933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2dc9068a-6c1a-41b9-a1ca-6b752d334749 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:41.012108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2dc9068a-6c1a-41b9-a1ca-6b752d334749 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:41.021681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2dc9068a-6c1a-41b9-a1ca-6b752d334749 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1556 microversion: 2.1 time: 0.155701 Aug 30 01:56:41.022753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 114/230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:40 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:41.043156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0145e6ce-379d-4a21-8eba-2545aab3eb79 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:41.043636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0145e6ce-379d-4a21-8eba-2545aab3eb79 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:41.049579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0145e6ce-379d-4a21-8eba-2545aab3eb79 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:41.050060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0145e6ce-379d-4a21-8eba-2545aab3eb79 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:41.050506 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0145e6ce-379d-4a21-8eba-2545aab3eb79 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:41.051280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0145e6ce-379d-4a21-8eba-2545aab3eb79 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:41.051847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0145e6ce-379d-4a21-8eba-2545aab3eb79 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:41.052295 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0145e6ce-379d-4a21-8eba-2545aab3eb79 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:41.180475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0145e6ce-379d-4a21-8eba-2545aab3eb79 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131726 Aug 30 01:56:41.180475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 115/231] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 01:56:41 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:56:41.461983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c7247532-719f-4de6-8e4d-142883aa040a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:41.463001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c7247532-719f-4de6-8e4d-142883aa040a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:41.471386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7247532-719f-4de6-8e4d-142883aa040a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:41.472170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7247532-719f-4de6-8e4d-142883aa040a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:41.472867 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7247532-719f-4de6-8e4d-142883aa040a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:41.473720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7247532-719f-4de6-8e4d-142883aa040a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:41.474235 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7247532-719f-4de6-8e4d-142883aa040a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:41.474853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7247532-719f-4de6-8e4d-142883aa040a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:41.616863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c7247532-719f-4de6-8e4d-142883aa040a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:41.624598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c7247532-719f-4de6-8e4d-142883aa040a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.166889 Aug 30 01:56:41.625419 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 116/232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:41 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:42.219001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-9872a653-68dc-4f3e-b38f-e67f342df75e req-298e9a3d-0ce9-4b8b-93c9-ffe8bb5aacc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f76949-51c7-4027-bca6-70e517d28eec", "tag": "33449dfd-7aea-47a8-bf04-2dbf480241dd"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:42.228281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9872a653-68dc-4f3e-b38f-e67f342df75e req-298e9a3d-0ce9-4b8b-93c9-ffe8bb5aacc2 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:42.229069 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9872a653-68dc-4f3e-b38f-e67f342df75e req-298e9a3d-0ce9-4b8b-93c9-ffe8bb5aacc2 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:42.229500 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9872a653-68dc-4f3e-b38f-e67f342df75e req-298e9a3d-0ce9-4b8b-93c9-ffe8bb5aacc2 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:42.241155 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-9872a653-68dc-4f3e-b38f-e67f342df75e req-298e9a3d-0ce9-4b8b-93c9-ffe8bb5aacc2 service nova] Creating event network-changed:33449dfd-7aea-47a8-bf04-2dbf480241dd for instance 22f76949-51c7-4027-bca6-70e517d28eec on hv-cinder-81966 Aug 30 01:56:42.246579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-9872a653-68dc-4f3e-b38f-e67f342df75e req-298e9a3d-0ce9-4b8b-93c9-ffe8bb5aacc2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031175 Aug 30 01:56:42.247273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 117/233] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:56:42.647764 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-abba9f8c-9f73-4cbd-94fc-33f76d377730 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:42.649052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-abba9f8c-9f73-4cbd-94fc-33f76d377730 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:42.663256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abba9f8c-9f73-4cbd-94fc-33f76d377730 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:42.663753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abba9f8c-9f73-4cbd-94fc-33f76d377730 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:42.664199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abba9f8c-9f73-4cbd-94fc-33f76d377730 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:42.664926 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abba9f8c-9f73-4cbd-94fc-33f76d377730 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:42.666916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abba9f8c-9f73-4cbd-94fc-33f76d377730 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:42.667530 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abba9f8c-9f73-4cbd-94fc-33f76d377730 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:43.004649 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-abba9f8c-9f73-4cbd-94fc-33f76d377730 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:43.015727 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-abba9f8c-9f73-4cbd-94fc-33f76d377730 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.373136 Aug 30 01:56:43.017302 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 118/234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:42 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:44.037163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5058ee04-bf4b-45e4-9190-e91aaff38733 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:44.037928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5058ee04-bf4b-45e4-9190-e91aaff38733 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:44.043884 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5058ee04-bf4b-45e4-9190-e91aaff38733 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:44.044570 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5058ee04-bf4b-45e4-9190-e91aaff38733 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:44.045003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5058ee04-bf4b-45e4-9190-e91aaff38733 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:44.046298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5058ee04-bf4b-45e4-9190-e91aaff38733 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:44.046748 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5058ee04-bf4b-45e4-9190-e91aaff38733 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:44.047174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5058ee04-bf4b-45e4-9190-e91aaff38733 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:44.179089 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5058ee04-bf4b-45e4-9190-e91aaff38733 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:44.189353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5058ee04-bf4b-45e4-9190-e91aaff38733 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.155245 Aug 30 01:56:44.189936 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 119/235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:44 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:56:44.978712 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5066cf7d-443f-4163-aa45-4b23999efdb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "POST /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.884961 Aug 30 01:56:44.980257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 117/236] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 01:56:40 2022] POST /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851/os-volume_attachments => generated 194 bytes in 4888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:56:45.210972 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-44192105-0919-45d2-835f-39f29e25043d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:45.211533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-44192105-0919-45d2-835f-39f29e25043d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:45.217350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44192105-0919-45d2-835f-39f29e25043d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:45.217823 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44192105-0919-45d2-835f-39f29e25043d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:45.218246 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44192105-0919-45d2-835f-39f29e25043d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:45.218913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44192105-0919-45d2-835f-39f29e25043d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:45.219355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44192105-0919-45d2-835f-39f29e25043d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:45.219794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44192105-0919-45d2-835f-39f29e25043d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:45.345299 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-44192105-0919-45d2-835f-39f29e25043d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:45.352849 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-44192105-0919-45d2-835f-39f29e25043d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.146003 Aug 30 01:56:45.353407 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 120/237] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:45 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:46.374328 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cdcac888-260d-428b-a401-2d3c470343a1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:46.375014 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cdcac888-260d-428b-a401-2d3c470343a1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:46.381617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdcac888-260d-428b-a401-2d3c470343a1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:46.382088 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdcac888-260d-428b-a401-2d3c470343a1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:46.382522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdcac888-260d-428b-a401-2d3c470343a1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:46.383191 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdcac888-260d-428b-a401-2d3c470343a1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:46.383665 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdcac888-260d-428b-a401-2d3c470343a1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:46.384079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cdcac888-260d-428b-a401-2d3c470343a1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:46.520552 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cdcac888-260d-428b-a401-2d3c470343a1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:46.533218 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cdcac888-260d-428b-a401-2d3c470343a1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1361 microversion: 2.1 time: 0.162977 Aug 30 01:56:46.534227 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 118/238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:46 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:47.553694 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2f5bd230-5eb4-43cd-8088-ce53f4e8e6bd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:47.554622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2f5bd230-5eb4-43cd-8088-ce53f4e8e6bd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:47.561335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2f5bd230-5eb4-43cd-8088-ce53f4e8e6bd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:47.562023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2f5bd230-5eb4-43cd-8088-ce53f4e8e6bd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:47.562466 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2f5bd230-5eb4-43cd-8088-ce53f4e8e6bd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:47.563286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2f5bd230-5eb4-43cd-8088-ce53f4e8e6bd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:47.564589 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2f5bd230-5eb4-43cd-8088-ce53f4e8e6bd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:47.565132 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2f5bd230-5eb4-43cd-8088-ce53f4e8e6bd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:47.698245 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2f5bd230-5eb4-43cd-8088-ce53f4e8e6bd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:56:47.707189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2f5bd230-5eb4-43cd-8088-ce53f4e8e6bd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1547 microversion: 2.1 time: 0.157135 Aug 30 01:56:47.720492 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 121/239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:56:47 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:47.729607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-384296fe-6098-40d0-94e7-5ec65728543c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:47.730138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-384296fe-6098-40d0-94e7-5ec65728543c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:56:47.737308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-384296fe-6098-40d0-94e7-5ec65728543c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:47.737778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-384296fe-6098-40d0-94e7-5ec65728543c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:47.738203 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-384296fe-6098-40d0-94e7-5ec65728543c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:47.738871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-384296fe-6098-40d0-94e7-5ec65728543c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:47.739316 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-384296fe-6098-40d0-94e7-5ec65728543c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:47.739735 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-384296fe-6098-40d0-94e7-5ec65728543c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:47.817359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-384296fe-6098-40d0-94e7-5ec65728543c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091665 Aug 30 01:56:47.820290 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 119/240] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 01:56:47 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:56:49.615909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-1431af32-df53-4edd-b062-42476510fd9a req-8d939557-1327-4d46-9e01-7d151bfed026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cf13980-f99e-4a83-9ec5-95e80147696b", "tag": "73d5c135-a67f-4c18-bc03-d0162506c894"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:56:49.627248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-1431af32-df53-4edd-b062-42476510fd9a req-8d939557-1327-4d46-9e01-7d151bfed026 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:56:49.628226 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-1431af32-df53-4edd-b062-42476510fd9a req-8d939557-1327-4d46-9e01-7d151bfed026 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:56:49.628756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-1431af32-df53-4edd-b062-42476510fd9a req-8d939557-1327-4d46-9e01-7d151bfed026 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:56:49.641007 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-1431af32-df53-4edd-b062-42476510fd9a req-8d939557-1327-4d46-9e01-7d151bfed026 service nova] Creating event network-changed:73d5c135-a67f-4c18-bc03-d0162506c894 for instance 1cf13980-f99e-4a83-9ec5-95e80147696b on hv-cinder-81966 Aug 30 01:56:49.650018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-1431af32-df53-4edd-b062-42476510fd9a req-8d939557-1327-4d46-9e01-7d151bfed026 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037667 Aug 30 01:56:49.650937 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 122/241] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:57:00.140424 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=58 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:00.141334 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:00.146062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b6eb64c0-e09d-4fdf-9a5f-ff1ddf8c8106 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:00.146552 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b6eb64c0-e09d-4fdf-9a5f-ff1ddf8c8106 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:00.154189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6eb64c0-e09d-4fdf-9a5f-ff1ddf8c8106 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:00.154665 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6eb64c0-e09d-4fdf-9a5f-ff1ddf8c8106 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:00.155090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6eb64c0-e09d-4fdf-9a5f-ff1ddf8c8106 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:00.155770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6eb64c0-e09d-4fdf-9a5f-ff1ddf8c8106 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:00.156214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6eb64c0-e09d-4fdf-9a5f-ff1ddf8c8106 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:00.156651 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b6eb64c0-e09d-4fdf-9a5f-ff1ddf8c8106 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:00.182588 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b6eb64c0-e09d-4fdf-9a5f-ff1ddf8c8106 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:57:00.279689 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b6eb64c0-e09d-4fdf-9a5f-ff1ddf8c8106 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 204 len: 0 microversion: 2.1 time: 0.140510 Aug 30 01:57:00.280615 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 120/242] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 01:57:00 2022] DELETE /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:57:00.289495 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-56e16ebd-eb32-4f41-99fe-fa40f36f6a40 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:00.291363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-56e16ebd-eb32-4f41-99fe-fa40f36f6a40 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:00.293914 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=73 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:00.297792 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=78 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:00.311940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-56e16ebd-eb32-4f41-99fe-fa40f36f6a40 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:00.312830 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-56e16ebd-eb32-4f41-99fe-fa40f36f6a40 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:00.316233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-56e16ebd-eb32-4f41-99fe-fa40f36f6a40 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:00.317604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-56e16ebd-eb32-4f41-99fe-fa40f36f6a40 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:00.320089 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-56e16ebd-eb32-4f41-99fe-fa40f36f6a40 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:00.320835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-56e16ebd-eb32-4f41-99fe-fa40f36f6a40 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:00.460450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-56e16ebd-eb32-4f41-99fe-fa40f36f6a40 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:00.468901 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-56e16ebd-eb32-4f41-99fe-fa40f36f6a40 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1554 microversion: 2.1 time: 0.183524 Aug 30 01:57:00.469645 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 123/243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:00 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:01.490918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dd393b2b-43f8-4028-89eb-a3bdc202bbb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:01.491692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dd393b2b-43f8-4028-89eb-a3bdc202bbb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:01.498097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dd393b2b-43f8-4028-89eb-a3bdc202bbb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:01.498593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dd393b2b-43f8-4028-89eb-a3bdc202bbb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:01.499114 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dd393b2b-43f8-4028-89eb-a3bdc202bbb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:01.499879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dd393b2b-43f8-4028-89eb-a3bdc202bbb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:01.500428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dd393b2b-43f8-4028-89eb-a3bdc202bbb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:01.500851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dd393b2b-43f8-4028-89eb-a3bdc202bbb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:01.642644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dd393b2b-43f8-4028-89eb-a3bdc202bbb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:01.660522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dd393b2b-43f8-4028-89eb-a3bdc202bbb0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1554 microversion: 2.1 time: 0.173570 Aug 30 01:57:01.661131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 121/244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:01 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:02.681933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ad50332e-2092-4062-ab4a-abd26a88d608 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:02.682602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ad50332e-2092-4062-ab4a-abd26a88d608 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:02.702057 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad50332e-2092-4062-ab4a-abd26a88d608 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:02.705209 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad50332e-2092-4062-ab4a-abd26a88d608 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:02.706035 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad50332e-2092-4062-ab4a-abd26a88d608 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:02.711215 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad50332e-2092-4062-ab4a-abd26a88d608 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:02.712362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad50332e-2092-4062-ab4a-abd26a88d608 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:02.712978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad50332e-2092-4062-ab4a-abd26a88d608 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:02.903024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ad50332e-2092-4062-ab4a-abd26a88d608 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:02.913202 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ad50332e-2092-4062-ab4a-abd26a88d608 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1554 microversion: 2.1 time: 0.235869 Aug 30 01:57:02.913793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 124/245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:02 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:03.839328 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-33a2a0da-d70b-4267-9386-8212863f807c req-8672a473-f29f-4e7c-9eae-d005217c4b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc020eb2-3c25-4134-a4c7-509b49c21851", "name": "network-vif-deleted", "tag": "5a4eae3d-bb7e-4af7-bd34-515aa4be72ed"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:57:03.857248 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-33a2a0da-d70b-4267-9386-8212863f807c req-8672a473-f29f-4e7c-9eae-d005217c4b8e service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:03.857771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-33a2a0da-d70b-4267-9386-8212863f807c req-8672a473-f29f-4e7c-9eae-d005217c4b8e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:03.862240 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-33a2a0da-d70b-4267-9386-8212863f807c req-8672a473-f29f-4e7c-9eae-d005217c4b8e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:03.907027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-33a2a0da-d70b-4267-9386-8212863f807c req-8672a473-f29f-4e7c-9eae-d005217c4b8e service nova] Creating event network-vif-deleted:5a4eae3d-bb7e-4af7-bd34-515aa4be72ed for instance fc020eb2-3c25-4134-a4c7-509b49c21851 on hv-cinder-81966 Aug 30 01:57:03.922546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-33a2a0da-d70b-4267-9386-8212863f807c req-8672a473-f29f-4e7c-9eae-d005217c4b8e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086866 Aug 30 01:57:03.923839 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 122/246] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:57:03.936174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f64be898-bca9-4cf2-8571-800fb665ffe4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:03.936960 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f64be898-bca9-4cf2-8571-800fb665ffe4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:03.947808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f64be898-bca9-4cf2-8571-800fb665ffe4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:03.948201 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f64be898-bca9-4cf2-8571-800fb665ffe4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:03.948695 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f64be898-bca9-4cf2-8571-800fb665ffe4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:03.949369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f64be898-bca9-4cf2-8571-800fb665ffe4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:03.950707 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f64be898-bca9-4cf2-8571-800fb665ffe4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:03.951140 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f64be898-bca9-4cf2-8571-800fb665ffe4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:04.064918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f64be898-bca9-4cf2-8571-800fb665ffe4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:04.076218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f64be898-bca9-4cf2-8571-800fb665ffe4 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1345 microversion: 2.1 time: 0.144487 Aug 30 01:57:04.077397 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 125/247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:03 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:05.100295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:05.101059 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:05.110903 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:05.111425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:05.111865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:05.112605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:05.113080 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:05.113510 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:05.207547 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:05.208912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:05.209389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:05.210939 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lazy-loading 'fault' on Instance uuid fc020eb2-3c25-4134-a4c7-509b49c21851 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:57:05.344516 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc7381cfffee4842bee1950a18caf807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7212d15b6463f834e8d1cc4ebf685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:05.352973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-67243e25-daaa-4e73-9573-d74639a589d0 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 200 len: 1304 microversion: 2.1 time: 0.258769 Aug 30 01:57:05.367678 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 123/248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:05 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 1304 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:06.373694 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:06.374302 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:06.385597 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:06.386396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:06.386946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:06.393825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:06.394578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:06.395239 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:06.422163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] HTTP exception thrown: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Request method failure captured: Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 HTTP/1.1 Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4YJvpLPDkxyumGVCAjpb6NC_Eodi0qGFqRZ49MgTWR_WinwAkWGSPz1q_r7AlySbxasSjIKEaZrmlSvvD1np091TloMMv_2Y1tGxLai2Nkp-LzYtZr-YKMczkQPijXOFDQ2rGCzM7eDl8IOR2D7D5FqI0WbTlTSkAEm9iIEGyXjm4 Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: f4a7212d15b6463f834e8d1cc4ebf685 Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 01:57:06.431465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f4a7212d15b6463f834e8d1cc4ebf685"}]}] Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: f4a7212d15b6463f834e8d1cc4ebf685 Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-DeleteServersTestJSON-872838751-project Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: cc7381cfffee4842bee1950a18caf807 Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-DeleteServersTestJSON-872838751-project Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:06.432813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': 'fc020eb2-3c25-4134-a4c7-509b49c21851'} Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:57:06.433668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:06.435021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:57:06.437117 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Returning 404 to user: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:57:06.438486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a77464df-f46f-4a82-bbe6-075c256f59e1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 404 len: 111 microversion: 2.1 time: 0.068240 Aug 30 01:57:06.440277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 126/249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:06 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:57:06.607303 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:06.609568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:06.615923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:06.616488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:06.616923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:06.617618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:06.618069 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:06.618497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:06.639836 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] HTTP exception thrown: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Request method failure captured: Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851/os-volume_attachments HTTP/1.1 Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4YJvpLPDkxyumGVCAjpb6NC_Eodi0qGFqRZ49MgTWR_WinwAkWGSPz1q_r7AlySbxasSjIKEaZrmlSvvD1np091TloMMv_2Y1tGxLai2Nkp-LzYtZr-YKMczkQPijXOFDQ2rGCzM7eDl8IOR2D7D5FqI0WbTlTSkAEm9iIEGyXjm4 Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: f4a7212d15b6463f834e8d1cc4ebf685 Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 01:57:06.660051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f4a7212d15b6463f834e8d1cc4ebf685"}]}] Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: f4a7212d15b6463f834e8d1cc4ebf685 Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-DeleteServersTestJSON-872838751-project Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: cc7381cfffee4842bee1950a18caf807 Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-DeleteServersTestJSON-872838751-project Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:06.661392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'server_id': 'fc020eb2-3c25-4134-a4c7-509b49c21851'} Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:57:06.662042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:06.663090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:57:06.666753 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Returning 404 to user: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:57:06.667638 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8a62a4d8-02af-4748-8078-d9608b07160f tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064245 Aug 30 01:57:06.671769 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 124/250] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 01:57:06 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:57:07.991478 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:07.992718 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:07.999322 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:07.999812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:08.000261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:08.000985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:08.001478 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:08.002156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:08.017625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] HTTP exception thrown: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Request method failure captured: Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: DELETE /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 HTTP/1.1 Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4YJvpLPDkxyumGVCAjpb6NC_Eodi0qGFqRZ49MgTWR_WinwAkWGSPz1q_r7AlySbxasSjIKEaZrmlSvvD1np091TloMMv_2Y1tGxLai2Nkp-LzYtZr-YKMczkQPijXOFDQ2rGCzM7eDl8IOR2D7D5FqI0WbTlTSkAEm9iIEGyXjm4 Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: f4a7212d15b6463f834e8d1cc4ebf685 Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 01:57:08.019330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f4a7212d15b6463f834e8d1cc4ebf685"}]}] Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: f4a7212d15b6463f834e8d1cc4ebf685 Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-DeleteServersTestJSON-872838751-project Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: cc7381cfffee4842bee1950a18caf807 Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-DeleteServersTestJSON-872838751-project Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:08.020692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': 'fc020eb2-3c25-4134-a4c7-509b49c21851'} Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:57:08.021351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:08.022562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:57:08.025103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Returning 404 to user: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:57:08.025103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b11cbe41-3f39-475f-9d0e-a5a3338a41a1 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 404 len: 111 microversion: 2.1 time: 0.034605 Aug 30 01:57:08.025103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 127/251] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 01:57:07 2022] DELETE /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:57:08.031062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:08.032147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] [instance: fc020eb2-3c25-4134-a4c7-509b49c21851] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:08.040051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:08.040689 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:08.041203 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:08.041968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:08.042519 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:08.043011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:08.067087 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] HTTP exception thrown: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Request method failure captured: Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 HTTP/1.1 Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4YJvpLPDkxyumGVCAjpb6NC_Eodi0qGFqRZ49MgTWR_WinwAkWGSPz1q_r7AlySbxasSjIKEaZrmlSvvD1np091TloMMv_2Y1tGxLai2Nkp-LzYtZr-YKMczkQPijXOFDQ2rGCzM7eDl8IOR2D7D5FqI0WbTlTSkAEm9iIEGyXjm4 Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: f4a7212d15b6463f834e8d1cc4ebf685 Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 01:57:08.070026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f4a7212d15b6463f834e8d1cc4ebf685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f4a7212d15b6463f834e8d1cc4ebf685"}]}] Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: f4a7212d15b6463f834e8d1cc4ebf685 Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-DeleteServersTestJSON-872838751 Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-DeleteServersTestJSON-872838751-project Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: cc7381cfffee4842bee1950a18caf807 Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-DeleteServersTestJSON-872838751-project Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:08.071468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': 'fc020eb2-3c25-4134-a4c7-509b49c21851'} Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:57:08.072232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. Aug 30 01:57:08.074068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:57:08.076504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] Returning 404 to user: Instance fc020eb2-3c25-4134-a4c7-509b49c21851 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:57:08.077374 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5004d57f-4596-426a-829d-8e7c3dc617d8 tempest-DeleteServersTestJSON-872838751 tempest-DeleteServersTestJSON-872838751-project] 10.222.0.50 "GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851" status: 404 len: 111 microversion: 2.1 time: 0.050291 Aug 30 01:57:08.077941 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 125/252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:08 2022] GET /compute/v2.1/servers/fc020eb2-3c25-4134-a4c7-509b49c21851 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:57:15.391411 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-89da19df-c1fe-4dd5-b7e8-a8e23e0bb944 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Action: 'create', calling method: .version_select at 0x7f3b08442280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1268717129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa/kw9qQ7gM5JgmPFDnzOEGE3bSXxEYzUTm8yfobYfV3BnaQDgCAPdMaVQO9/oSQA5vWTv32reRlDA7Sm5WRUbjz9/KmVm7YowPM+SAyVo+Q3Aw+RlZ1zwOdKg8eSznBA=="}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:57:15.419687 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-89da19df-c1fe-4dd5-b7e8-a8e23e0bb944 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Getting quotas for project 7c116c9cfbc144769d453e218b02739b. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:57:15.430667 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-89da19df-c1fe-4dd5-b7e8-a8e23e0bb944 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Getting quotas for user 1fafe6ce050545b8870f88d4ae0aa1ca and project 7c116c9cfbc144769d453e218b02739b. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:57:15.478413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-89da19df-c1fe-4dd5-b7e8-a8e23e0bb944 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.363970 Aug 30 01:57:15.479672 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 128/253] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 01:57:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:57:22.741483 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:22.742720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:22.870833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-129006467", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:57:22.962826 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] validate_networks() for [('22623ea0-0f64-4b42-91fc-13e8bf6bfe27', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:57:23.372151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:57:23.372603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:57:23.373073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:57:23.373478 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:57:23.373881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:57:23.383472 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:23.383947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:23.384410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:23.385132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:23.385589 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:23.386006 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:23.402515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Getting quotas for project 688f10cbc5ce42b895bb7a9285749cca. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:57:23.406493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Getting quotas for user 86f364f03c7d4360b4a75ed194846ade and project 688f10cbc5ce42b895bb7a9285749cca. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:57:23.417423 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:57:23.419701 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:57:23.467965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b070f4bd-a6d4-423c-aa85-db8058375251 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.731882 Aug 30 01:57:23.468767 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 126/254] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:57:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:57:23.477290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=22 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:23.481379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-93256eb2-1f66-4fe5-83dd-a251c15fa8e7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:23.481986 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-93256eb2-1f66-4fe5-83dd-a251c15fa8e7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:23.535183 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-93256eb2-1f66-4fe5-83dd-a251c15fa8e7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:23.546727 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-93256eb2-1f66-4fe5-83dd-a251c15fa8e7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1221 microversion: 2.1 time: 0.070362 Aug 30 01:57:23.547309 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 129/255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:23 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:23.638110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2072729631", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:57:23.723235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] validate_networks() for [('22623ea0-0f64-4b42-91fc-13e8bf6bfe27', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:57:24.206184 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:57:24.206862 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:57:24.207213 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:57:24.207618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:57:24.208027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:57:24.217220 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:24.217700 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:24.218350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:24.219245 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:24.220308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:24.220824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:24.238372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Getting quotas for project 688f10cbc5ce42b895bb7a9285749cca. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:57:24.243482 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Getting quotas for user 86f364f03c7d4360b4a75ed194846ade and project 688f10cbc5ce42b895bb7a9285749cca. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:57:24.254668 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:57:24.257351 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:57:24.314008 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8a09dd9a-baa0-442a-ba5e-0529cfc1de7f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.687731 Aug 30 01:57:24.320634 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 127/256] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:57:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:57:24.325862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-df7e1ffd-3cd6-4391-9bf0-7fe86418cd73 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:24.326473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-df7e1ffd-3cd6-4391-9bf0-7fe86418cd73 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:24.393650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-df7e1ffd-3cd6-4391-9bf0-7fe86418cd73 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:24.402100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-df7e1ffd-3cd6-4391-9bf0-7fe86418cd73 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1222 microversion: 2.1 time: 0.078690 Aug 30 01:57:24.402772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 130/257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:24 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:57:25.423495 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ea5973c7-60ad-41de-9dda-99a8cd4cb1c5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:25.424108 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ea5973c7-60ad-41de-9dda-99a8cd4cb1c5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:25.432530 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea5973c7-60ad-41de-9dda-99a8cd4cb1c5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:25.433266 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea5973c7-60ad-41de-9dda-99a8cd4cb1c5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:25.433854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea5973c7-60ad-41de-9dda-99a8cd4cb1c5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:25.434771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea5973c7-60ad-41de-9dda-99a8cd4cb1c5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:25.435405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea5973c7-60ad-41de-9dda-99a8cd4cb1c5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:25.435885 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea5973c7-60ad-41de-9dda-99a8cd4cb1c5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:25.523019 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ea5973c7-60ad-41de-9dda-99a8cd4cb1c5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:25.536957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ea5973c7-60ad-41de-9dda-99a8cd4cb1c5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1218 microversion: 2.1 time: 0.117875 Aug 30 01:57:25.538217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 128/258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:25 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:26.558021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c4c19dc9-09f1-4027-b524-1eb3b2a1665b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:26.558627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c4c19dc9-09f1-4027-b524-1eb3b2a1665b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:26.567911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c19dc9-09f1-4027-b524-1eb3b2a1665b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:26.568436 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c19dc9-09f1-4027-b524-1eb3b2a1665b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:26.568868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c19dc9-09f1-4027-b524-1eb3b2a1665b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:26.569733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c19dc9-09f1-4027-b524-1eb3b2a1665b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:26.570346 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c19dc9-09f1-4027-b524-1eb3b2a1665b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:26.571078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c19dc9-09f1-4027-b524-1eb3b2a1665b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:26.640379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c4c19dc9-09f1-4027-b524-1eb3b2a1665b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:26.649062 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c4c19dc9-09f1-4027-b524-1eb3b2a1665b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1218 microversion: 2.1 time: 0.094719 Aug 30 01:57:26.649694 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 131/259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:26 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:27.670925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fb1fe13e-f4ec-4eb6-94ab-ae2d2b623547 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:27.671846 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fb1fe13e-f4ec-4eb6-94ab-ae2d2b623547 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:27.678292 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb1fe13e-f4ec-4eb6-94ab-ae2d2b623547 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:27.679016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb1fe13e-f4ec-4eb6-94ab-ae2d2b623547 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:27.679645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb1fe13e-f4ec-4eb6-94ab-ae2d2b623547 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:27.680365 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb1fe13e-f4ec-4eb6-94ab-ae2d2b623547 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:27.681005 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb1fe13e-f4ec-4eb6-94ab-ae2d2b623547 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:27.681432 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fb1fe13e-f4ec-4eb6-94ab-ae2d2b623547 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:27.747593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fb1fe13e-f4ec-4eb6-94ab-ae2d2b623547 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:27.757190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fb1fe13e-f4ec-4eb6-94ab-ae2d2b623547 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1218 microversion: 2.1 time: 0.090920 Aug 30 01:57:27.757906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 129/260] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:27 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:28.778631 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9034b688-3c88-419c-be66-9ace73854ab9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:28.779232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9034b688-3c88-419c-be66-9ace73854ab9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:28.785987 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9034b688-3c88-419c-be66-9ace73854ab9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:28.786460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9034b688-3c88-419c-be66-9ace73854ab9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:28.787167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9034b688-3c88-419c-be66-9ace73854ab9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:28.787663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9034b688-3c88-419c-be66-9ace73854ab9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:28.788031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9034b688-3c88-419c-be66-9ace73854ab9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:28.788479 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9034b688-3c88-419c-be66-9ace73854ab9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:28.849213 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9034b688-3c88-419c-be66-9ace73854ab9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:28.856971 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9034b688-3c88-419c-be66-9ace73854ab9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1218 microversion: 2.1 time: 0.082236 Aug 30 01:57:28.857527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 132/261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:28 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:29.877914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-953996d5-4f99-42c1-9704-874b44372947 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:29.878506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-953996d5-4f99-42c1-9704-874b44372947 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:29.884973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-953996d5-4f99-42c1-9704-874b44372947 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:29.885454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-953996d5-4f99-42c1-9704-874b44372947 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:29.885886 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-953996d5-4f99-42c1-9704-874b44372947 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:29.886602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-953996d5-4f99-42c1-9704-874b44372947 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:29.887056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-953996d5-4f99-42c1-9704-874b44372947 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:29.887478 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-953996d5-4f99-42c1-9704-874b44372947 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:29.945977 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-953996d5-4f99-42c1-9704-874b44372947 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:29.953482 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-953996d5-4f99-42c1-9704-874b44372947 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1218 microversion: 2.1 time: 0.079648 Aug 30 01:57:29.954072 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 130/262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:29 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:30.973886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-28288cbc-b820-4366-a002-035efb350dc2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:30.974480 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-28288cbc-b820-4366-a002-035efb350dc2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:30.976318 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:30.981554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28288cbc-b820-4366-a002-035efb350dc2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:30.982027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28288cbc-b820-4366-a002-035efb350dc2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:30.982451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28288cbc-b820-4366-a002-035efb350dc2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:30.983127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28288cbc-b820-4366-a002-035efb350dc2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:30.983570 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28288cbc-b820-4366-a002-035efb350dc2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:30.983987 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28288cbc-b820-4366-a002-035efb350dc2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:31.047560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-28288cbc-b820-4366-a002-035efb350dc2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:31.056556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-28288cbc-b820-4366-a002-035efb350dc2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1218 microversion: 2.1 time: 0.086443 Aug 30 01:57:31.057118 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 133/263] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:30 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:32.077761 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9a82eb68-b791-4abd-abad-f566723eb0a5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:32.078467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9a82eb68-b791-4abd-abad-f566723eb0a5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:32.085115 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a82eb68-b791-4abd-abad-f566723eb0a5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:32.085595 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a82eb68-b791-4abd-abad-f566723eb0a5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:32.086021 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a82eb68-b791-4abd-abad-f566723eb0a5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:32.086727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a82eb68-b791-4abd-abad-f566723eb0a5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:32.087172 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a82eb68-b791-4abd-abad-f566723eb0a5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:32.087769 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a82eb68-b791-4abd-abad-f566723eb0a5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:32.161475 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9a82eb68-b791-4abd-abad-f566723eb0a5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:32.169509 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9a82eb68-b791-4abd-abad-f566723eb0a5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1274 microversion: 2.1 time: 0.095581 Aug 30 01:57:32.170072 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 131/264] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:32 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:33.196873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-10e6d84a-e76e-40c0-98ec-dfee17a24392 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:33.196873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-10e6d84a-e76e-40c0-98ec-dfee17a24392 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:33.201491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-10e6d84a-e76e-40c0-98ec-dfee17a24392 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:33.201946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-10e6d84a-e76e-40c0-98ec-dfee17a24392 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:33.202373 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-10e6d84a-e76e-40c0-98ec-dfee17a24392 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:33.203057 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-10e6d84a-e76e-40c0-98ec-dfee17a24392 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:33.203499 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-10e6d84a-e76e-40c0-98ec-dfee17a24392 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:33.203945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-10e6d84a-e76e-40c0-98ec-dfee17a24392 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:33.364141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-10e6d84a-e76e-40c0-98ec-dfee17a24392 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:33.373389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-10e6d84a-e76e-40c0-98ec-dfee17a24392 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1282 microversion: 2.1 time: 0.185405 Aug 30 01:57:33.374386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 134/265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:33 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:33.737001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-40aede8a-edc9-4c15-981f-c1085e5a8c20 req-9b38f6b7-e47a-4e2f-abfd-40d5888e737e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48eb7084-94aa-46f2-911d-ca2463bfb25c", "tag": "df6d0b90-2209-4de5-8e5b-ad7cb5df0caf"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:57:33.749568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-40aede8a-edc9-4c15-981f-c1085e5a8c20 req-9b38f6b7-e47a-4e2f-abfd-40d5888e737e service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:33.750236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-40aede8a-edc9-4c15-981f-c1085e5a8c20 req-9b38f6b7-e47a-4e2f-abfd-40d5888e737e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:33.751429 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-40aede8a-edc9-4c15-981f-c1085e5a8c20 req-9b38f6b7-e47a-4e2f-abfd-40d5888e737e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:33.773705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-40aede8a-edc9-4c15-981f-c1085e5a8c20 req-9b38f6b7-e47a-4e2f-abfd-40d5888e737e service nova] Creating event network-changed:df6d0b90-2209-4de5-8e5b-ad7cb5df0caf for instance 48eb7084-94aa-46f2-911d-ca2463bfb25c on hv-cinder-81966 Aug 30 01:57:33.786104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-40aede8a-edc9-4c15-981f-c1085e5a8c20 req-9b38f6b7-e47a-4e2f-abfd-40d5888e737e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053233 Aug 30 01:57:33.786788 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 132/266] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:57:34.398064 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-da550675-04f6-463e-bc9a-8840ed29093b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:34.412369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-da550675-04f6-463e-bc9a-8840ed29093b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:34.412369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=8 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:34.412369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-da550675-04f6-463e-bc9a-8840ed29093b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:34.412369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-da550675-04f6-463e-bc9a-8840ed29093b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:34.412683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-da550675-04f6-463e-bc9a-8840ed29093b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:34.412683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-da550675-04f6-463e-bc9a-8840ed29093b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:34.412683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-da550675-04f6-463e-bc9a-8840ed29093b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:34.412683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-da550675-04f6-463e-bc9a-8840ed29093b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:34.784492 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-da550675-04f6-463e-bc9a-8840ed29093b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:34.794001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-da550675-04f6-463e-bc9a-8840ed29093b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.401429 Aug 30 01:57:34.795551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 135/267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:34 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:35.801546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-6a6bf968-ed9c-4f6a-95be-bd913b0a82fc req-05132c4f-1651-46f1-a5d7-04f9601569a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4545ddca-1552-48ca-96fe-f8a605e82b1b", "tag": "12232d57-49a7-4e71-b0d3-4e6a819228a8"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:57:35.806523 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:35.807178 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=12 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:35.813001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6a6bf968-ed9c-4f6a-95be-bd913b0a82fc req-05132c4f-1651-46f1-a5d7-04f9601569a1 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:35.813782 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6a6bf968-ed9c-4f6a-95be-bd913b0a82fc req-05132c4f-1651-46f1-a5d7-04f9601569a1 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:35.814214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-6a6bf968-ed9c-4f6a-95be-bd913b0a82fc req-05132c4f-1651-46f1-a5d7-04f9601569a1 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:35.818085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4d1f7939-af76-4e9a-bf7f-7e3ab2bbfdc4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:35.819238 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4d1f7939-af76-4e9a-bf7f-7e3ab2bbfdc4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:35.825471 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4d1f7939-af76-4e9a-bf7f-7e3ab2bbfdc4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:35.825896 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-6a6bf968-ed9c-4f6a-95be-bd913b0a82fc req-05132c4f-1651-46f1-a5d7-04f9601569a1 service nova] Creating event network-changed:12232d57-49a7-4e71-b0d3-4e6a819228a8 for instance 4545ddca-1552-48ca-96fe-f8a605e82b1b on hv-cinder-81966 Aug 30 01:57:35.826018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4d1f7939-af76-4e9a-bf7f-7e3ab2bbfdc4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:35.826451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4d1f7939-af76-4e9a-bf7f-7e3ab2bbfdc4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:35.827285 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4d1f7939-af76-4e9a-bf7f-7e3ab2bbfdc4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:35.828009 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4d1f7939-af76-4e9a-bf7f-7e3ab2bbfdc4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:35.828930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4d1f7939-af76-4e9a-bf7f-7e3ab2bbfdc4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:35.830725 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-6a6bf968-ed9c-4f6a-95be-bd913b0a82fc req-05132c4f-1651-46f1-a5d7-04f9601569a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033670 Aug 30 01:57:35.831228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 133/268] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:57:35.972520 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4d1f7939-af76-4e9a-bf7f-7e3ab2bbfdc4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:35.981608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4d1f7939-af76-4e9a-bf7f-7e3ab2bbfdc4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.168327 Aug 30 01:57:35.982460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 136/269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:35 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:57:37.004479 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9b55c1af-5078-4eec-8326-377e792d5f63 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:37.005258 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9b55c1af-5078-4eec-8326-377e792d5f63 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:37.011567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b55c1af-5078-4eec-8326-377e792d5f63 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:37.012052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b55c1af-5078-4eec-8326-377e792d5f63 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:37.012874 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b55c1af-5078-4eec-8326-377e792d5f63 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:37.013637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b55c1af-5078-4eec-8326-377e792d5f63 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:37.014108 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b55c1af-5078-4eec-8326-377e792d5f63 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:37.014518 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b55c1af-5078-4eec-8326-377e792d5f63 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:37.152457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9b55c1af-5078-4eec-8326-377e792d5f63 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:37.160024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9b55c1af-5078-4eec-8326-377e792d5f63 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.161008 Aug 30 01:57:37.160786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 134/270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:36 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:38.182197 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bcc3273d-c385-4a7d-8a7e-d917f5c23748 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:38.182800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bcc3273d-c385-4a7d-8a7e-d917f5c23748 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:38.188808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc3273d-c385-4a7d-8a7e-d917f5c23748 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:38.189282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc3273d-c385-4a7d-8a7e-d917f5c23748 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:38.189711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc3273d-c385-4a7d-8a7e-d917f5c23748 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:38.190384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc3273d-c385-4a7d-8a7e-d917f5c23748 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:38.190842 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc3273d-c385-4a7d-8a7e-d917f5c23748 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:38.191889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc3273d-c385-4a7d-8a7e-d917f5c23748 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:38.359985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-bcc3273d-c385-4a7d-8a7e-d917f5c23748 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:38.359985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bcc3273d-c385-4a7d-8a7e-d917f5c23748 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.181010 Aug 30 01:57:38.359985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 137/271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:38 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:39.381949 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4d93726b-b3b5-4894-8a5d-7ec61ed0974a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:39.382644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4d93726b-b3b5-4894-8a5d-7ec61ed0974a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:39.388955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d93726b-b3b5-4894-8a5d-7ec61ed0974a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:39.389428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d93726b-b3b5-4894-8a5d-7ec61ed0974a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:39.389853 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d93726b-b3b5-4894-8a5d-7ec61ed0974a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:39.390523 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d93726b-b3b5-4894-8a5d-7ec61ed0974a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:39.390965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d93726b-b3b5-4894-8a5d-7ec61ed0974a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:39.391381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d93726b-b3b5-4894-8a5d-7ec61ed0974a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:39.521749 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4d93726b-b3b5-4894-8a5d-7ec61ed0974a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:39.529744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4d93726b-b3b5-4894-8a5d-7ec61ed0974a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.152817 Aug 30 01:57:39.530353 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 135/272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:39 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:40.550692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-334d1727-4fd6-4025-9996-34ae02abea92 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:40.551287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-334d1727-4fd6-4025-9996-34ae02abea92 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:40.557215 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-334d1727-4fd6-4025-9996-34ae02abea92 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:40.557688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-334d1727-4fd6-4025-9996-34ae02abea92 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:40.558117 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-334d1727-4fd6-4025-9996-34ae02abea92 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:40.558788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-334d1727-4fd6-4025-9996-34ae02abea92 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:40.559234 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-334d1727-4fd6-4025-9996-34ae02abea92 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:40.559649 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-334d1727-4fd6-4025-9996-34ae02abea92 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:40.685074 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-334d1727-4fd6-4025-9996-34ae02abea92 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:40.693085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-334d1727-4fd6-4025-9996-34ae02abea92 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.145963 Aug 30 01:57:40.693638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 138/273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:40 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:41.713727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3b06b530-490a-483d-8f87-e3f91855ab23 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:41.714356 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3b06b530-490a-483d-8f87-e3f91855ab23 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:41.720346 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b06b530-490a-483d-8f87-e3f91855ab23 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:41.720824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b06b530-490a-483d-8f87-e3f91855ab23 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:41.721251 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b06b530-490a-483d-8f87-e3f91855ab23 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:41.721924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b06b530-490a-483d-8f87-e3f91855ab23 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:41.722367 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b06b530-490a-483d-8f87-e3f91855ab23 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:41.722781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3b06b530-490a-483d-8f87-e3f91855ab23 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:41.851427 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3b06b530-490a-483d-8f87-e3f91855ab23 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:41.859512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3b06b530-490a-483d-8f87-e3f91855ab23 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.149489 Aug 30 01:57:41.860136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 136/274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:41 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:42.880166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-676debbc-44c5-4716-878e-6f3edc0db046 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:42.880798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-676debbc-44c5-4716-878e-6f3edc0db046 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:42.886787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-676debbc-44c5-4716-878e-6f3edc0db046 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:42.887309 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-676debbc-44c5-4716-878e-6f3edc0db046 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:42.887745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-676debbc-44c5-4716-878e-6f3edc0db046 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:42.888456 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-676debbc-44c5-4716-878e-6f3edc0db046 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:42.888907 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-676debbc-44c5-4716-878e-6f3edc0db046 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:42.889326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-676debbc-44c5-4716-878e-6f3edc0db046 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:43.017467 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-676debbc-44c5-4716-878e-6f3edc0db046 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:43.025157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-676debbc-44c5-4716-878e-6f3edc0db046 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.149050 Aug 30 01:57:43.025749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 139/275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:42 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:44.047401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-52ac11f9-dc3b-4523-9a94-c7bbb1ddda26 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:44.049319 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-52ac11f9-dc3b-4523-9a94-c7bbb1ddda26 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:44.057796 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52ac11f9-dc3b-4523-9a94-c7bbb1ddda26 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:44.059206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52ac11f9-dc3b-4523-9a94-c7bbb1ddda26 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:44.059867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52ac11f9-dc3b-4523-9a94-c7bbb1ddda26 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:44.061456 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52ac11f9-dc3b-4523-9a94-c7bbb1ddda26 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:44.062132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52ac11f9-dc3b-4523-9a94-c7bbb1ddda26 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:44.063179 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-52ac11f9-dc3b-4523-9a94-c7bbb1ddda26 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:44.254926 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-52ac11f9-dc3b-4523-9a94-c7bbb1ddda26 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:44.264152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-52ac11f9-dc3b-4523-9a94-c7bbb1ddda26 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.221354 Aug 30 01:57:44.278064 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 137/276] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:44 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:45.285543 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d763c62c-7824-4738-9ed4-521a9f6efaa2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:45.286162 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d763c62c-7824-4738-9ed4-521a9f6efaa2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:45.292277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d763c62c-7824-4738-9ed4-521a9f6efaa2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:45.292774 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d763c62c-7824-4738-9ed4-521a9f6efaa2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:45.293200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d763c62c-7824-4738-9ed4-521a9f6efaa2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:45.294071 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d763c62c-7824-4738-9ed4-521a9f6efaa2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:45.294674 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d763c62c-7824-4738-9ed4-521a9f6efaa2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:45.295101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d763c62c-7824-4738-9ed4-521a9f6efaa2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:45.423119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d763c62c-7824-4738-9ed4-521a9f6efaa2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:45.431193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d763c62c-7824-4738-9ed4-521a9f6efaa2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.149428 Aug 30 01:57:45.431752 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 140/277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:45 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:46.452456 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2a3969ac-8848-41b9-8199-ef13d95b9bcb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:46.453216 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2a3969ac-8848-41b9-8199-ef13d95b9bcb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:46.460117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a3969ac-8848-41b9-8199-ef13d95b9bcb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:46.461343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a3969ac-8848-41b9-8199-ef13d95b9bcb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:46.461796 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a3969ac-8848-41b9-8199-ef13d95b9bcb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:46.462499 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a3969ac-8848-41b9-8199-ef13d95b9bcb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:46.462955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a3969ac-8848-41b9-8199-ef13d95b9bcb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:46.463390 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2a3969ac-8848-41b9-8199-ef13d95b9bcb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:46.594131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2a3969ac-8848-41b9-8199-ef13d95b9bcb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:46.602419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2a3969ac-8848-41b9-8199-ef13d95b9bcb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.153933 Aug 30 01:57:46.602979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 138/278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:46 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:47.071532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-f5a7905b-1643-4aa0-8aad-b7b27284aed2 req-0f0f6a57-b465-4131-92c1-fc62d2ebe6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48eb7084-94aa-46f2-911d-ca2463bfb25c", "name": "network-vif-plugged", "status": "completed", "tag": "df6d0b90-2209-4de5-8e5b-ad7cb5df0caf"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:57:47.081037 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-f5a7905b-1643-4aa0-8aad-b7b27284aed2 req-0f0f6a57-b465-4131-92c1-fc62d2ebe6d5 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:47.081507 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-f5a7905b-1643-4aa0-8aad-b7b27284aed2 req-0f0f6a57-b465-4131-92c1-fc62d2ebe6d5 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:47.081931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-f5a7905b-1643-4aa0-8aad-b7b27284aed2 req-0f0f6a57-b465-4131-92c1-fc62d2ebe6d5 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:47.093369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-f5a7905b-1643-4aa0-8aad-b7b27284aed2 req-0f0f6a57-b465-4131-92c1-fc62d2ebe6d5 service nova] Creating event network-vif-plugged:df6d0b90-2209-4de5-8e5b-ad7cb5df0caf for instance 48eb7084-94aa-46f2-911d-ca2463bfb25c on hv-cinder-81966 Aug 30 01:57:47.098230 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-f5a7905b-1643-4aa0-8aad-b7b27284aed2 req-0f0f6a57-b465-4131-92c1-fc62d2ebe6d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031028 Aug 30 01:57:47.099386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 141/279] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:57:47.351130 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-28696708", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "networks": [{"uuid": "223989b8-81d0-4cea-81c0-85c9576407f1"}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:57:47.403932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] validate_networks() for [('223989b8-81d0-4cea-81c0-85c9576407f1', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:57:47.624418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-60b98d09-d0cd-4b53-bd27-eb9cf0754e00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:47.625452 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-60b98d09-d0cd-4b53-bd27-eb9cf0754e00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:47.632537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60b98d09-d0cd-4b53-bd27-eb9cf0754e00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:47.633031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60b98d09-d0cd-4b53-bd27-eb9cf0754e00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:47.633466 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60b98d09-d0cd-4b53-bd27-eb9cf0754e00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:47.634359 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60b98d09-d0cd-4b53-bd27-eb9cf0754e00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:47.634813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60b98d09-d0cd-4b53-bd27-eb9cf0754e00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:47.635237 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60b98d09-d0cd-4b53-bd27-eb9cf0754e00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:47.738996 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:57:47.740131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:57:47.740632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:57:47.741040 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:57:47.741436 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:57:47.751167 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:47.751649 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:47.752078 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:47.753091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:47.753546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:47.753959 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:47.764054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-60b98d09-d0cd-4b53-bd27-eb9cf0754e00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:47.775497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Getting quotas for project 154f5229567c4023adcbe0069a9b4abb. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:57:47.776719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Getting quotas for user aa5c9d73b6bb4b32b2da9386273690bb and project 154f5229567c4023adcbe0069a9b4abb. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:57:47.779638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-60b98d09-d0cd-4b53-bd27-eb9cf0754e00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.159393 Aug 30 01:57:47.780402 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 142/280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:47 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:57:47.787625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:57:47.789956 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:57:47.844887 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-812ba4f3-1c8b-4b0b-8166-141f681ba316 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497540 Aug 30 01:57:47.845509 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 139/281] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:57:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:57:47.856366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-19dfe59f-f912-447a-9ddf-8b1b73178a73 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:47.856975 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-19dfe59f-f912-447a-9ddf-8b1b73178a73 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:47.911114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-19dfe59f-f912-447a-9ddf-8b1b73178a73 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:47.918631 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-19dfe59f-f912-447a-9ddf-8b1b73178a73 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1212 microversion: 2.1 time: 0.066117 Aug 30 01:57:47.919200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 143/282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:47 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1212 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:48.800990 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6f615498-ee79-4d15-a270-d9e1e0c0adbf tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:48.801605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6f615498-ee79-4d15-a270-d9e1e0c0adbf tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:48.807570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f615498-ee79-4d15-a270-d9e1e0c0adbf tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:48.808056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f615498-ee79-4d15-a270-d9e1e0c0adbf tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:48.808531 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f615498-ee79-4d15-a270-d9e1e0c0adbf tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:48.809219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f615498-ee79-4d15-a270-d9e1e0c0adbf tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:48.809699 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f615498-ee79-4d15-a270-d9e1e0c0adbf tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:48.810129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f615498-ee79-4d15-a270-d9e1e0c0adbf tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:48.941962 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5ede1c85-ca30-43e2-ae06-995003bf9f8a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:48.943284 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5ede1c85-ca30-43e2-ae06-995003bf9f8a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:48.943992 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6f615498-ee79-4d15-a270-d9e1e0c0adbf tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:48.952543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6f615498-ee79-4d15-a270-d9e1e0c0adbf tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.155821 Aug 30 01:57:48.953875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 140/283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:48 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:48.954004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ede1c85-ca30-43e2-ae06-995003bf9f8a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:48.954448 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ede1c85-ca30-43e2-ae06-995003bf9f8a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:48.955076 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ede1c85-ca30-43e2-ae06-995003bf9f8a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:48.955773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ede1c85-ca30-43e2-ae06-995003bf9f8a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:48.956447 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ede1c85-ca30-43e2-ae06-995003bf9f8a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:48.957041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ede1c85-ca30-43e2-ae06-995003bf9f8a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:49.026368 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ede1c85-ca30-43e2-ae06-995003bf9f8a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:49.035727 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5ede1c85-ca30-43e2-ae06-995003bf9f8a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1208 microversion: 2.1 time: 0.100390 Aug 30 01:57:49.038273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 144/284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:48 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1208 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:57:49.976857 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-296fb335-f2a9-48d4-90e4-c08e7d4ffb09 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:49.977607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-296fb335-f2a9-48d4-90e4-c08e7d4ffb09 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:49.984271 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-296fb335-f2a9-48d4-90e4-c08e7d4ffb09 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:49.984782 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-296fb335-f2a9-48d4-90e4-c08e7d4ffb09 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:49.985428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-296fb335-f2a9-48d4-90e4-c08e7d4ffb09 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:49.986152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-296fb335-f2a9-48d4-90e4-c08e7d4ffb09 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:49.986632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-296fb335-f2a9-48d4-90e4-c08e7d4ffb09 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:49.987076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-296fb335-f2a9-48d4-90e4-c08e7d4ffb09 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:50.063515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-944c13e5-6895-4785-952b-d39eeb41904d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:50.065259 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-944c13e5-6895-4785-952b-d39eeb41904d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:50.076129 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-944c13e5-6895-4785-952b-d39eeb41904d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:50.079029 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-944c13e5-6895-4785-952b-d39eeb41904d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:50.079561 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-944c13e5-6895-4785-952b-d39eeb41904d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:50.081373 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-944c13e5-6895-4785-952b-d39eeb41904d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:50.081912 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-944c13e5-6895-4785-952b-d39eeb41904d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:50.084078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-944c13e5-6895-4785-952b-d39eeb41904d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:50.172284 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-296fb335-f2a9-48d4-90e4-c08e7d4ffb09 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:50.186162 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-296fb335-f2a9-48d4-90e4-c08e7d4ffb09 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.208942 Aug 30 01:57:50.186704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-944c13e5-6895-4785-952b-d39eeb41904d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:50.187686 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 141/285] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:49 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:50.191733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-944c13e5-6895-4785-952b-d39eeb41904d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1264 microversion: 2.1 time: 0.132537 Aug 30 01:57:50.193203 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 145/286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:50 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1264 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:51.150927 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-77c7b610-776a-4796-839f-b57f17d70ef1 req-64378b4b-25a7-4ae2-832c-213b7eb4fae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4545ddca-1552-48ca-96fe-f8a605e82b1b", "name": "network-vif-plugged", "status": "completed", "tag": "12232d57-49a7-4e71-b0d3-4e6a819228a8"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:57:51.162688 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-77c7b610-776a-4796-839f-b57f17d70ef1 req-64378b4b-25a7-4ae2-832c-213b7eb4fae3 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:51.163366 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-77c7b610-776a-4796-839f-b57f17d70ef1 req-64378b4b-25a7-4ae2-832c-213b7eb4fae3 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:51.164094 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-77c7b610-776a-4796-839f-b57f17d70ef1 req-64378b4b-25a7-4ae2-832c-213b7eb4fae3 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:51.181231 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-77c7b610-776a-4796-839f-b57f17d70ef1 req-64378b4b-25a7-4ae2-832c-213b7eb4fae3 service nova] Creating event network-vif-plugged:12232d57-49a7-4e71-b0d3-4e6a819228a8 for instance 4545ddca-1552-48ca-96fe-f8a605e82b1b on hv-cinder-81966 Aug 30 01:57:51.186658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-77c7b610-776a-4796-839f-b57f17d70ef1 req-64378b4b-25a7-4ae2-832c-213b7eb4fae3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040799 Aug 30 01:57:51.187908 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 142/287] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:57:51.216185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6030100c-9d4c-460f-9fc5-988bc336921d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:51.216871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6030100c-9d4c-460f-9fc5-988bc336921d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:51.228017 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6030100c-9d4c-460f-9fc5-988bc336921d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:51.233762 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-834e3bf4-b511-46b2-a30d-1fabc3e93574 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:51.235204 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-834e3bf4-b511-46b2-a30d-1fabc3e93574 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:51.236935 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6030100c-9d4c-460f-9fc5-988bc336921d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:51.237461 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6030100c-9d4c-460f-9fc5-988bc336921d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:51.238191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6030100c-9d4c-460f-9fc5-988bc336921d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:51.238654 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6030100c-9d4c-460f-9fc5-988bc336921d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:51.240498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6030100c-9d4c-460f-9fc5-988bc336921d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:51.249065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834e3bf4-b511-46b2-a30d-1fabc3e93574 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:51.249560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834e3bf4-b511-46b2-a30d-1fabc3e93574 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:51.249976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834e3bf4-b511-46b2-a30d-1fabc3e93574 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:51.250857 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834e3bf4-b511-46b2-a30d-1fabc3e93574 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:51.251459 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834e3bf4-b511-46b2-a30d-1fabc3e93574 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:51.252021 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-834e3bf4-b511-46b2-a30d-1fabc3e93574 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:51.326702 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-834e3bf4-b511-46b2-a30d-1fabc3e93574 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:51.335385 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-834e3bf4-b511-46b2-a30d-1fabc3e93574 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1272 microversion: 2.1 time: 0.115398 Aug 30 01:57:51.335992 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 143/288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:51 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:51.414467 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6030100c-9d4c-460f-9fc5-988bc336921d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:51.422441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6030100c-9d4c-460f-9fc5-988bc336921d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.211610 Aug 30 01:57:51.423203 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 146/289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:51 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:52.355376 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4f199a34-cd0b-4705-a622-ecffdd741cbb tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:52.355974 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4f199a34-cd0b-4705-a622-ecffdd741cbb tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:52.362866 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f199a34-cd0b-4705-a622-ecffdd741cbb tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:52.363361 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f199a34-cd0b-4705-a622-ecffdd741cbb tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:52.363787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f199a34-cd0b-4705-a622-ecffdd741cbb tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:52.364719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f199a34-cd0b-4705-a622-ecffdd741cbb tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:52.365165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f199a34-cd0b-4705-a622-ecffdd741cbb tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:52.365794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f199a34-cd0b-4705-a622-ecffdd741cbb tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:52.434521 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4f199a34-cd0b-4705-a622-ecffdd741cbb tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:52.442261 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4f199a34-cd0b-4705-a622-ecffdd741cbb tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1270 microversion: 2.1 time: 0.090631 Aug 30 01:57:52.443366 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 144/290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:52 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:52.445997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-16a8578c-342a-4ef1-b032-69690d9e9c85 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:52.447331 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-16a8578c-342a-4ef1-b032-69690d9e9c85 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:52.454787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16a8578c-342a-4ef1-b032-69690d9e9c85 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:52.455646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16a8578c-342a-4ef1-b032-69690d9e9c85 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:52.456326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16a8578c-342a-4ef1-b032-69690d9e9c85 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:52.457770 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16a8578c-342a-4ef1-b032-69690d9e9c85 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:52.459578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16a8578c-342a-4ef1-b032-69690d9e9c85 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:52.460609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16a8578c-342a-4ef1-b032-69690d9e9c85 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:52.664670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-16a8578c-342a-4ef1-b032-69690d9e9c85 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:52.672917 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-16a8578c-342a-4ef1-b032-69690d9e9c85 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.233070 Aug 30 01:57:52.673745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 147/291] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:52 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:57:53.463301 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-19834965-6ccf-4753-b4e0-3f9341756b96 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:53.463902 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-19834965-6ccf-4753-b4e0-3f9341756b96 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:53.466288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=9 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:53.471336 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-19834965-6ccf-4753-b4e0-3f9341756b96 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:53.471816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-19834965-6ccf-4753-b4e0-3f9341756b96 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:53.472288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-19834965-6ccf-4753-b4e0-3f9341756b96 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:53.472971 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-19834965-6ccf-4753-b4e0-3f9341756b96 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:53.473418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-19834965-6ccf-4753-b4e0-3f9341756b96 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:53.474336 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-19834965-6ccf-4753-b4e0-3f9341756b96 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:53.477585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=91 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:53.604147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-19834965-6ccf-4753-b4e0-3f9341756b96 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:53.611719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-19834965-6ccf-4753-b4e0-3f9341756b96 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.152241 Aug 30 01:57:53.612287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 145/292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:53 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:53.693785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d487114f-ea01-41c4-8c23-d047fbf052ee tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:53.694390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d487114f-ea01-41c4-8c23-d047fbf052ee tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:53.700207 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d487114f-ea01-41c4-8c23-d047fbf052ee tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:53.700712 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d487114f-ea01-41c4-8c23-d047fbf052ee tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:53.701139 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d487114f-ea01-41c4-8c23-d047fbf052ee tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:53.701817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d487114f-ea01-41c4-8c23-d047fbf052ee tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:53.702263 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d487114f-ea01-41c4-8c23-d047fbf052ee tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:53.702681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d487114f-ea01-41c4-8c23-d047fbf052ee tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:53.705303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=93 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:53.898520 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d487114f-ea01-41c4-8c23-d047fbf052ee tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:53.906280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d487114f-ea01-41c4-8c23-d047fbf052ee tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.216304 Aug 30 01:57:53.906837 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 148/293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:53 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:57:54.399200 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-a581251b-37b3-4922-b1f9-eb3c52dc6e56 req-e2e33f9d-a7d4-41ff-a6b9-adb6b4077b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90", "tag": "25bc12e7-b1b1-4e1b-b92a-75eb4e0ea2f0"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:57:54.408688 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a581251b-37b3-4922-b1f9-eb3c52dc6e56 req-e2e33f9d-a7d4-41ff-a6b9-adb6b4077b09 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:54.409167 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a581251b-37b3-4922-b1f9-eb3c52dc6e56 req-e2e33f9d-a7d4-41ff-a6b9-adb6b4077b09 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:54.409593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a581251b-37b3-4922-b1f9-eb3c52dc6e56 req-e2e33f9d-a7d4-41ff-a6b9-adb6b4077b09 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:54.420289 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-a581251b-37b3-4922-b1f9-eb3c52dc6e56 req-e2e33f9d-a7d4-41ff-a6b9-adb6b4077b09 service nova] Creating event network-changed:25bc12e7-b1b1-4e1b-b92a-75eb4e0ea2f0 for instance 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 on hv-cinder-81966 Aug 30 01:57:54.425284 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-a581251b-37b3-4922-b1f9-eb3c52dc6e56 req-e2e33f9d-a7d4-41ff-a6b9-adb6b4077b09 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029866 Aug 30 01:57:54.426143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 146/294] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:57:54.633061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9a21f543-e994-4ca8-bfb0-d9e23179c88f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:54.633669 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9a21f543-e994-4ca8-bfb0-d9e23179c88f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:54.639573 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a21f543-e994-4ca8-bfb0-d9e23179c88f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:54.639993 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a21f543-e994-4ca8-bfb0-d9e23179c88f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:54.640470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a21f543-e994-4ca8-bfb0-d9e23179c88f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:54.641153 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a21f543-e994-4ca8-bfb0-d9e23179c88f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:54.641601 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a21f543-e994-4ca8-bfb0-d9e23179c88f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:54.642022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9a21f543-e994-4ca8-bfb0-d9e23179c88f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:54.769940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9a21f543-e994-4ca8-bfb0-d9e23179c88f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:54.778085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9a21f543-e994-4ca8-bfb0-d9e23179c88f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.149472 Aug 30 01:57:54.778638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 149/295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:54 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:54.927817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bca12e9e-b54e-4e27-b6f2-a08505b031b9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:54.928530 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bca12e9e-b54e-4e27-b6f2-a08505b031b9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:54.934674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bca12e9e-b54e-4e27-b6f2-a08505b031b9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:54.935147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bca12e9e-b54e-4e27-b6f2-a08505b031b9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:54.935569 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bca12e9e-b54e-4e27-b6f2-a08505b031b9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:54.936260 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bca12e9e-b54e-4e27-b6f2-a08505b031b9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:54.936708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bca12e9e-b54e-4e27-b6f2-a08505b031b9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:54.937124 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bca12e9e-b54e-4e27-b6f2-a08505b031b9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:55.062351 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bca12e9e-b54e-4e27-b6f2-a08505b031b9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:55.070394 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bca12e9e-b54e-4e27-b6f2-a08505b031b9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.147226 Aug 30 01:57:55.070948 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 147/296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:54 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:55.798075 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fb56cfe6-5bb0-4631-8134-e0f949ac2ced tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:55.798674 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-fb56cfe6-5bb0-4631-8134-e0f949ac2ced tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:55.805201 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb56cfe6-5bb0-4631-8134-e0f949ac2ced tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:55.805691 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb56cfe6-5bb0-4631-8134-e0f949ac2ced tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:55.806120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb56cfe6-5bb0-4631-8134-e0f949ac2ced tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:55.806837 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb56cfe6-5bb0-4631-8134-e0f949ac2ced tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:55.807283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb56cfe6-5bb0-4631-8134-e0f949ac2ced tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:55.807697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb56cfe6-5bb0-4631-8134-e0f949ac2ced tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:55.935021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-fb56cfe6-5bb0-4631-8134-e0f949ac2ced tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:55.943240 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-fb56cfe6-5bb0-4631-8134-e0f949ac2ced tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.148249 Aug 30 01:57:55.943807 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 150/297] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:55 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:56.090782 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4a590b52-f57e-463f-9a46-54c23dae2b95 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:56.091415 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4a590b52-f57e-463f-9a46-54c23dae2b95 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:56.097747 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a590b52-f57e-463f-9a46-54c23dae2b95 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:56.098222 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a590b52-f57e-463f-9a46-54c23dae2b95 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:56.098653 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a590b52-f57e-463f-9a46-54c23dae2b95 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:56.099378 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a590b52-f57e-463f-9a46-54c23dae2b95 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:56.099824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a590b52-f57e-463f-9a46-54c23dae2b95 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:56.100268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a590b52-f57e-463f-9a46-54c23dae2b95 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:56.222288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4a590b52-f57e-463f-9a46-54c23dae2b95 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:56.230327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4a590b52-f57e-463f-9a46-54c23dae2b95 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.143365 Aug 30 01:57:56.230881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 148/298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:56 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:56.964664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5a697fa9-50d9-496f-8970-d2f5987b35d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:56.965265 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5a697fa9-50d9-496f-8970-d2f5987b35d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:56.971135 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a697fa9-50d9-496f-8970-d2f5987b35d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:56.971604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a697fa9-50d9-496f-8970-d2f5987b35d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:56.972023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a697fa9-50d9-496f-8970-d2f5987b35d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:56.972731 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a697fa9-50d9-496f-8970-d2f5987b35d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:56.973173 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a697fa9-50d9-496f-8970-d2f5987b35d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:56.973587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a697fa9-50d9-496f-8970-d2f5987b35d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:57.097245 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5a697fa9-50d9-496f-8970-d2f5987b35d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:57.104631 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5a697fa9-50d9-496f-8970-d2f5987b35d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.143771 Aug 30 01:57:57.105215 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 151/299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:56 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:57.254055 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e54be2bf-8c42-4626-b680-e66085aa36fd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:57.255178 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e54be2bf-8c42-4626-b680-e66085aa36fd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:57.264070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e54be2bf-8c42-4626-b680-e66085aa36fd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:57.264581 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e54be2bf-8c42-4626-b680-e66085aa36fd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:57.265010 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e54be2bf-8c42-4626-b680-e66085aa36fd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:57.265687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e54be2bf-8c42-4626-b680-e66085aa36fd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:57.266130 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e54be2bf-8c42-4626-b680-e66085aa36fd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:57.266545 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e54be2bf-8c42-4626-b680-e66085aa36fd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:57.395321 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e54be2bf-8c42-4626-b680-e66085aa36fd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:57.402917 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e54be2bf-8c42-4626-b680-e66085aa36fd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.155921 Aug 30 01:57:57.403456 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 149/300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:57 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:58.124813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8efa02a0-64d3-4095-9bc9-349e3b061de3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:58.125346 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8efa02a0-64d3-4095-9bc9-349e3b061de3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:58.127172 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:58.133451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8efa02a0-64d3-4095-9bc9-349e3b061de3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:58.133930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8efa02a0-64d3-4095-9bc9-349e3b061de3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:58.134359 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8efa02a0-64d3-4095-9bc9-349e3b061de3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:58.135037 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8efa02a0-64d3-4095-9bc9-349e3b061de3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:58.135486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8efa02a0-64d3-4095-9bc9-349e3b061de3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:58.135904 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8efa02a0-64d3-4095-9bc9-349e3b061de3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:58.261444 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8efa02a0-64d3-4095-9bc9-349e3b061de3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:58.268937 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8efa02a0-64d3-4095-9bc9-349e3b061de3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.148025 Aug 30 01:57:58.269491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 152/301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:58 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:58.422650 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2329486c-8e8e-47d1-8528-d4504e2f4750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:58.423257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2329486c-8e8e-47d1-8528-d4504e2f4750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:58.425245 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:58.425897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:57:58.433349 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2329486c-8e8e-47d1-8528-d4504e2f4750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:58.433831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2329486c-8e8e-47d1-8528-d4504e2f4750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:58.434262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2329486c-8e8e-47d1-8528-d4504e2f4750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:58.434950 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2329486c-8e8e-47d1-8528-d4504e2f4750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:58.435401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2329486c-8e8e-47d1-8528-d4504e2f4750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:58.435820 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2329486c-8e8e-47d1-8528-d4504e2f4750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:58.565383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2329486c-8e8e-47d1-8528-d4504e2f4750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:58.572971 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2329486c-8e8e-47d1-8528-d4504e2f4750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.154096 Aug 30 01:57:58.573538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 150/302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:58 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:59.289012 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f4e02b09-1296-4d5b-a7e5-56d322deec35 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:59.289810 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f4e02b09-1296-4d5b-a7e5-56d322deec35 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:59.295980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e02b09-1296-4d5b-a7e5-56d322deec35 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:59.296491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e02b09-1296-4d5b-a7e5-56d322deec35 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:59.296935 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e02b09-1296-4d5b-a7e5-56d322deec35 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:59.297620 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e02b09-1296-4d5b-a7e5-56d322deec35 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:59.298065 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e02b09-1296-4d5b-a7e5-56d322deec35 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:59.298835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e02b09-1296-4d5b-a7e5-56d322deec35 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:59.421380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f4e02b09-1296-4d5b-a7e5-56d322deec35 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:59.428871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f4e02b09-1296-4d5b-a7e5-56d322deec35 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.143720 Aug 30 01:57:59.429431 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 153/303] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:59 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:57:59.592608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a9f47e3a-e304-4619-b5bc-8197ea6fcc19 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:57:59.593211 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a9f47e3a-e304-4619-b5bc-8197ea6fcc19 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:57:59.599499 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f47e3a-e304-4619-b5bc-8197ea6fcc19 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:59.599973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f47e3a-e304-4619-b5bc-8197ea6fcc19 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:59.600438 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f47e3a-e304-4619-b5bc-8197ea6fcc19 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:59.601114 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f47e3a-e304-4619-b5bc-8197ea6fcc19 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:57:59.601559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f47e3a-e304-4619-b5bc-8197ea6fcc19 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:57:59.601975 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f47e3a-e304-4619-b5bc-8197ea6fcc19 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:57:59.949176 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a9f47e3a-e304-4619-b5bc-8197ea6fcc19 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:57:59.957397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a9f47e3a-e304-4619-b5bc-8197ea6fcc19 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1322 microversion: 2.1 time: 0.368411 Aug 30 01:57:59.958032 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 151/304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:57:59 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:00.449845 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-899bc497-dea1-406a-b82b-807c536fa2ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:00.450554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-899bc497-dea1-406a-b82b-807c536fa2ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:00.456865 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-899bc497-dea1-406a-b82b-807c536fa2ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:00.457338 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-899bc497-dea1-406a-b82b-807c536fa2ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:00.457762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-899bc497-dea1-406a-b82b-807c536fa2ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:00.458439 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-899bc497-dea1-406a-b82b-807c536fa2ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:00.458880 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-899bc497-dea1-406a-b82b-807c536fa2ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:00.459293 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-899bc497-dea1-406a-b82b-807c536fa2ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:00.591959 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-899bc497-dea1-406a-b82b-807c536fa2ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:00.599714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-899bc497-dea1-406a-b82b-807c536fa2ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.153641 Aug 30 01:58:00.600281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 154/305] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:00 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:00.979494 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ecdae910-ffec-4374-847e-d13223c934c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:00.980036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ecdae910-ffec-4374-847e-d13223c934c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:00.986383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ecdae910-ffec-4374-847e-d13223c934c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:00.986862 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ecdae910-ffec-4374-847e-d13223c934c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:00.987293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ecdae910-ffec-4374-847e-d13223c934c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:00.987972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ecdae910-ffec-4374-847e-d13223c934c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:00.988518 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ecdae910-ffec-4374-847e-d13223c934c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:00.988942 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ecdae910-ffec-4374-847e-d13223c934c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:01.117590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ecdae910-ffec-4374-847e-d13223c934c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:01.125675 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ecdae910-ffec-4374-847e-d13223c934c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1516 microversion: 2.1 time: 0.150158 Aug 30 01:58:01.126235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 152/306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:00 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:01.147373 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c4c77f95-6959-477f-9241-4a0e7bf5ab00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:01.150182 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c4c77f95-6959-477f-9241-4a0e7bf5ab00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:01.153055 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=46 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:01.156779 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c77f95-6959-477f-9241-4a0e7bf5ab00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:01.157371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c77f95-6959-477f-9241-4a0e7bf5ab00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:01.157853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c77f95-6959-477f-9241-4a0e7bf5ab00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:01.158577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c77f95-6959-477f-9241-4a0e7bf5ab00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:01.159099 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c77f95-6959-477f-9241-4a0e7bf5ab00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:01.159524 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4c77f95-6959-477f-9241-4a0e7bf5ab00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:01.183341 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-c4c77f95-6959-477f-9241-4a0e7bf5ab00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lazy-loading 'flavor' on Instance uuid 4545ddca-1552-48ca-96fe-f8a605e82b1b {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:58:01.300136 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c4c77f95-6959-477f-9241-4a0e7bf5ab00 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b/action" status: 200 len: 32 microversion: 2.1 time: 0.156849 Aug 30 01:58:01.304932 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 155/307] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 01:58:01 2022] POST /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:58:01.310061 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-45f4c688-ecea-4567-900f-92be19c6c47d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:01.310691 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-45f4c688-ecea-4567-900f-92be19c6c47d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:01.316556 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45f4c688-ecea-4567-900f-92be19c6c47d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:01.317085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45f4c688-ecea-4567-900f-92be19c6c47d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:01.317526 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45f4c688-ecea-4567-900f-92be19c6c47d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:01.318246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45f4c688-ecea-4567-900f-92be19c6c47d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:01.318714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45f4c688-ecea-4567-900f-92be19c6c47d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:01.319130 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45f4c688-ecea-4567-900f-92be19c6c47d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:01.446157 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-45f4c688-ecea-4567-900f-92be19c6c47d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:01.453691 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-45f4c688-ecea-4567-900f-92be19c6c47d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.147502 Aug 30 01:58:01.454238 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 153/308] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:01 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:01.621186 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-efbf20a4-c1a1-49af-a349-8f353266bad0 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:01.621786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-efbf20a4-c1a1-49af-a349-8f353266bad0 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:01.628223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-efbf20a4-c1a1-49af-a349-8f353266bad0 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:01.628736 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-efbf20a4-c1a1-49af-a349-8f353266bad0 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:01.629164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-efbf20a4-c1a1-49af-a349-8f353266bad0 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:01.633138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-efbf20a4-c1a1-49af-a349-8f353266bad0 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:01.633606 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-efbf20a4-c1a1-49af-a349-8f353266bad0 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:01.634098 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-efbf20a4-c1a1-49af-a349-8f353266bad0 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:01.763657 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-efbf20a4-c1a1-49af-a349-8f353266bad0 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:01.771940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-efbf20a4-c1a1-49af-a349-8f353266bad0 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.154391 Aug 30 01:58:01.772443 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 156/309] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:01 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:02.475378 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2ddc00ad-5ac2-43b5-bdde-7631927e41e4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:02.475918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2ddc00ad-5ac2-43b5-bdde-7631927e41e4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:02.483268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddc00ad-5ac2-43b5-bdde-7631927e41e4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:02.483741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddc00ad-5ac2-43b5-bdde-7631927e41e4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:02.484171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddc00ad-5ac2-43b5-bdde-7631927e41e4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:02.484872 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddc00ad-5ac2-43b5-bdde-7631927e41e4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:02.485318 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddc00ad-5ac2-43b5-bdde-7631927e41e4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:02.485729 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ddc00ad-5ac2-43b5-bdde-7631927e41e4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:02.612590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2ddc00ad-5ac2-43b5-bdde-7631927e41e4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:02.622661 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2ddc00ad-5ac2-43b5-bdde-7631927e41e4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.151626 Aug 30 01:58:02.623588 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 154/310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:02 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:02.792819 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3b970880-679e-4feb-a413-3defd97b9846 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:02.793452 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3b970880-679e-4feb-a413-3defd97b9846 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:02.799315 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b970880-679e-4feb-a413-3defd97b9846 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:02.799793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b970880-679e-4feb-a413-3defd97b9846 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:02.800224 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b970880-679e-4feb-a413-3defd97b9846 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:02.800923 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b970880-679e-4feb-a413-3defd97b9846 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:02.801373 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b970880-679e-4feb-a413-3defd97b9846 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:02.801793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b970880-679e-4feb-a413-3defd97b9846 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:03.067153 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3b970880-679e-4feb-a413-3defd97b9846 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:03.075134 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3b970880-679e-4feb-a413-3defd97b9846 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.286169 Aug 30 01:58:03.075906 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 157/311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:02 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:03.645654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-62bd7158-49f2-46db-8a3e-4841a8654771 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:03.646183 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-62bd7158-49f2-46db-8a3e-4841a8654771 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:03.652534 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62bd7158-49f2-46db-8a3e-4841a8654771 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:03.653010 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62bd7158-49f2-46db-8a3e-4841a8654771 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:03.653441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62bd7158-49f2-46db-8a3e-4841a8654771 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:03.654112 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62bd7158-49f2-46db-8a3e-4841a8654771 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:03.654558 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62bd7158-49f2-46db-8a3e-4841a8654771 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:03.654973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-62bd7158-49f2-46db-8a3e-4841a8654771 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:03.781120 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-62bd7158-49f2-46db-8a3e-4841a8654771 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:03.789123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-62bd7158-49f2-46db-8a3e-4841a8654771 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.147378 Aug 30 01:58:03.789669 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 155/312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:03 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:04.095748 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a44182d5-ebd6-4903-a9ec-812da98f0aae tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:04.096389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a44182d5-ebd6-4903-a9ec-812da98f0aae tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:04.102385 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a44182d5-ebd6-4903-a9ec-812da98f0aae tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:04.102914 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a44182d5-ebd6-4903-a9ec-812da98f0aae tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:04.103345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a44182d5-ebd6-4903-a9ec-812da98f0aae tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:04.104027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a44182d5-ebd6-4903-a9ec-812da98f0aae tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:04.104499 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a44182d5-ebd6-4903-a9ec-812da98f0aae tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:04.104922 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a44182d5-ebd6-4903-a9ec-812da98f0aae tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:04.228786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a44182d5-ebd6-4903-a9ec-812da98f0aae tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:04.236201 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a44182d5-ebd6-4903-a9ec-812da98f0aae tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.144298 Aug 30 01:58:04.236764 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 158/313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:04 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:04.809605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-91167f44-7c30-4193-9921-eae8c3ae10de tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:04.810209 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-91167f44-7c30-4193-9921-eae8c3ae10de tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:04.816754 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91167f44-7c30-4193-9921-eae8c3ae10de tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:04.817316 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91167f44-7c30-4193-9921-eae8c3ae10de tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:04.817758 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91167f44-7c30-4193-9921-eae8c3ae10de tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:04.818633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91167f44-7c30-4193-9921-eae8c3ae10de tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:04.819103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91167f44-7c30-4193-9921-eae8c3ae10de tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:04.819844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91167f44-7c30-4193-9921-eae8c3ae10de tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:04.966890 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-91167f44-7c30-4193-9921-eae8c3ae10de tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:04.975307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-91167f44-7c30-4193-9921-eae8c3ae10de tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.168885 Aug 30 01:58:04.975768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 156/314] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:04 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:04.983037 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-276867266", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1268717129", "security_groups": [{"name": "tempest-secgroup-smoke-1227461786"}], "networks": [{"uuid": "7f12c991-7c13-49a0-b32c-0a80e438ed4a"}], "block_device_mapping_v2": [{"uuid": "7c139f37-aa73-429c-826f-a9c528b5bf82", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:05.102669 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.network.neutron [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] validate_networks() for [('7f12c991-7c13-49a0-b32c-0a80e438ed4a', None, None, None, None, None)] {{(pid=120391) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:58:05.258104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-09de0fcd-aae7-4875-b489-dfba16ff2dcd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:05.258989 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-09de0fcd-aae7-4875-b489-dfba16ff2dcd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:05.273079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09de0fcd-aae7-4875-b489-dfba16ff2dcd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:05.273568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09de0fcd-aae7-4875-b489-dfba16ff2dcd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:05.274000 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09de0fcd-aae7-4875-b489-dfba16ff2dcd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:05.274693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09de0fcd-aae7-4875-b489-dfba16ff2dcd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:05.275141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09de0fcd-aae7-4875-b489-dfba16ff2dcd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:05.275555 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09de0fcd-aae7-4875-b489-dfba16ff2dcd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:05.422436 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-09de0fcd-aae7-4875-b489-dfba16ff2dcd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:05.430067 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-09de0fcd-aae7-4875-b489-dfba16ff2dcd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.176432 Aug 30 01:58:05.430625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 157/315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:05 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:05.475882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Flavor limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:58:05.476427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Image limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:58:05.477022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Flavor pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:58:05.477518 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Image pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:58:05.478017 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:58:05.487747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:05.488343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:05.488863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:05.489690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:05.490286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:05.490789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:05.513185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Getting quotas for project 7c116c9cfbc144769d453e218b02739b. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:58:05.517449 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Getting quotas for user 1fafe6ce050545b8870f88d4ae0aa1ca and project 7c116c9cfbc144769d453e218b02739b. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:58:05.587054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Going to run 1 instances... {{(pid=120391) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:58:05.589925 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c139f37-aa73-429c-826f-a9c528b5bf82',volume_size=None,volume_type=None)] {{(pid=120391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:58:05.745211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-310c8977-d4a2-49b9-803a-9419e2e40be2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765934 Aug 30 01:58:05.746000 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 159/316] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:58:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:58:05.757421 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ed5c04c7-30a1-440f-a110-402b22d8714f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:05.758023 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ed5c04c7-30a1-440f-a110-402b22d8714f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:05.824660 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ed5c04c7-30a1-440f-a110-402b22d8714f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:05.832836 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ed5c04c7-30a1-440f-a110-402b22d8714f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1088 microversion: 2.1 time: 0.080144 Aug 30 01:58:05.833471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 158/317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:05 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:06.000025 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1fd16c82-154b-490d-81b6-4c58dcbf7a46 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:06.000694 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1fd16c82-154b-490d-81b6-4c58dcbf7a46 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:06.011045 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1fd16c82-154b-490d-81b6-4c58dcbf7a46 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:06.011804 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1fd16c82-154b-490d-81b6-4c58dcbf7a46 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:06.012235 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1fd16c82-154b-490d-81b6-4c58dcbf7a46 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:06.013359 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1fd16c82-154b-490d-81b6-4c58dcbf7a46 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:06.013512 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1fd16c82-154b-490d-81b6-4c58dcbf7a46 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:06.013832 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1fd16c82-154b-490d-81b6-4c58dcbf7a46 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:06.171353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1fd16c82-154b-490d-81b6-4c58dcbf7a46 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:06.182230 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1fd16c82-154b-490d-81b6-4c58dcbf7a46 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.186465 Aug 30 01:58:06.182866 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 160/318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:05 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:06.450764 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c68d5585-a393-401d-8bff-312a2411c025 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:06.451810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c68d5585-a393-401d-8bff-312a2411c025 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:06.457874 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c68d5585-a393-401d-8bff-312a2411c025 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:06.458350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c68d5585-a393-401d-8bff-312a2411c025 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:06.458781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c68d5585-a393-401d-8bff-312a2411c025 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:06.459493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c68d5585-a393-401d-8bff-312a2411c025 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:06.459938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c68d5585-a393-401d-8bff-312a2411c025 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:06.460390 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c68d5585-a393-401d-8bff-312a2411c025 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:06.757069 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c68d5585-a393-401d-8bff-312a2411c025 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:06.766834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c68d5585-a393-401d-8bff-312a2411c025 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.319769 Aug 30 01:58:06.767865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 159/319] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:06 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:06.853852 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f39e7001-7342-4bbf-b8b6-66592145f9aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:06.854646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f39e7001-7342-4bbf-b8b6-66592145f9aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:06.861268 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f39e7001-7342-4bbf-b8b6-66592145f9aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:06.861935 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f39e7001-7342-4bbf-b8b6-66592145f9aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:06.862527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f39e7001-7342-4bbf-b8b6-66592145f9aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:06.863367 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f39e7001-7342-4bbf-b8b6-66592145f9aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:06.863977 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f39e7001-7342-4bbf-b8b6-66592145f9aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:06.864567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f39e7001-7342-4bbf-b8b6-66592145f9aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:06.947984 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f39e7001-7342-4bbf-b8b6-66592145f9aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:06.958345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f39e7001-7342-4bbf-b8b6-66592145f9aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1186 microversion: 2.1 time: 0.108507 Aug 30 01:58:06.958967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 161/320] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:06 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1186 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:07.202841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-72f8f96c-827b-4091-b31c-941757313c5c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:07.203539 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-72f8f96c-827b-4091-b31c-941757313c5c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:07.209983 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-72f8f96c-827b-4091-b31c-941757313c5c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:07.210535 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-72f8f96c-827b-4091-b31c-941757313c5c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:07.211035 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-72f8f96c-827b-4091-b31c-941757313c5c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:07.211790 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-72f8f96c-827b-4091-b31c-941757313c5c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:07.212346 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-72f8f96c-827b-4091-b31c-941757313c5c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:07.212852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-72f8f96c-827b-4091-b31c-941757313c5c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:07.366219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-72f8f96c-827b-4091-b31c-941757313c5c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:07.376265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-72f8f96c-827b-4091-b31c-941757313c5c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.177119 Aug 30 01:58:07.376961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 160/321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:07 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:07.792091 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a88ffc26-63cf-4154-aeff-0a40a7de9cf2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:07.792995 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a88ffc26-63cf-4154-aeff-0a40a7de9cf2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:07.800986 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a88ffc26-63cf-4154-aeff-0a40a7de9cf2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:07.801625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a88ffc26-63cf-4154-aeff-0a40a7de9cf2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:07.802150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a88ffc26-63cf-4154-aeff-0a40a7de9cf2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:07.803172 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a88ffc26-63cf-4154-aeff-0a40a7de9cf2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:07.804279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a88ffc26-63cf-4154-aeff-0a40a7de9cf2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:07.804937 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a88ffc26-63cf-4154-aeff-0a40a7de9cf2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:07.981393 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-05fb47de-0422-429b-9c94-3bfc2bddd8b4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:07.982260 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-05fb47de-0422-429b-9c94-3bfc2bddd8b4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:07.988667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05fb47de-0422-429b-9c94-3bfc2bddd8b4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:07.989443 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05fb47de-0422-429b-9c94-3bfc2bddd8b4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:07.990123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05fb47de-0422-429b-9c94-3bfc2bddd8b4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:07.991051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05fb47de-0422-429b-9c94-3bfc2bddd8b4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:07.991905 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05fb47de-0422-429b-9c94-3bfc2bddd8b4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:07.992601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05fb47de-0422-429b-9c94-3bfc2bddd8b4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:08.024177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a88ffc26-63cf-4154-aeff-0a40a7de9cf2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:08.032054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a88ffc26-63cf-4154-aeff-0a40a7de9cf2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.245111 Aug 30 01:58:08.032837 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 162/322] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:07 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:08.073223 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-05fb47de-0422-429b-9c94-3bfc2bddd8b4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:08.081715 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-05fb47de-0422-429b-9c94-3bfc2bddd8b4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1204 microversion: 2.1 time: 0.104952 Aug 30 01:58:08.082484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 161/323] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:07 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1204 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:08.381151 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-6de9511d-45b2-438a-87dd-748116d402cd req-e0442fc4-68c9-4a58-9fc4-42fac0c9e424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90", "name": "network-vif-plugged", "status": "completed", "tag": "25bc12e7-b1b1-4e1b-b92a-75eb4e0ea2f0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:08.398141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f87133eb-cc2e-4727-84c1-e78e2674e8b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:08.398746 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f87133eb-cc2e-4727-84c1-e78e2674e8b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:08.408476 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-6de9511d-45b2-438a-87dd-748116d402cd req-e0442fc4-68c9-4a58-9fc4-42fac0c9e424 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:08.408966 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-6de9511d-45b2-438a-87dd-748116d402cd req-e0442fc4-68c9-4a58-9fc4-42fac0c9e424 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:08.409401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-6de9511d-45b2-438a-87dd-748116d402cd req-e0442fc4-68c9-4a58-9fc4-42fac0c9e424 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:08.419255 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f87133eb-cc2e-4727-84c1-e78e2674e8b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:08.419766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f87133eb-cc2e-4727-84c1-e78e2674e8b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:08.420274 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f87133eb-cc2e-4727-84c1-e78e2674e8b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:08.420958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f87133eb-cc2e-4727-84c1-e78e2674e8b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:08.421420 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f87133eb-cc2e-4727-84c1-e78e2674e8b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:08.421843 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f87133eb-cc2e-4727-84c1-e78e2674e8b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:08.436553 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-6de9511d-45b2-438a-87dd-748116d402cd req-e0442fc4-68c9-4a58-9fc4-42fac0c9e424 service nova] Creating event network-vif-plugged:25bc12e7-b1b1-4e1b-b92a-75eb4e0ea2f0 for instance 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 on hv-cinder-81966 Aug 30 01:58:08.444044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-6de9511d-45b2-438a-87dd-748116d402cd req-e0442fc4-68c9-4a58-9fc4-42fac0c9e424 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065908 Aug 30 01:58:08.445832 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 163/324] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:58:08.690033 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f87133eb-cc2e-4727-84c1-e78e2674e8b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:08.700337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f87133eb-cc2e-4727-84c1-e78e2674e8b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.305977 Aug 30 01:58:08.701214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 162/325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:08 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:09.054087 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-eb4b94e4-8a62-4cb6-9349-d4e7b6382da5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:09.054811 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-eb4b94e4-8a62-4cb6-9349-d4e7b6382da5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:09.066215 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb4b94e4-8a62-4cb6-9349-d4e7b6382da5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:09.066734 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb4b94e4-8a62-4cb6-9349-d4e7b6382da5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:09.067321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb4b94e4-8a62-4cb6-9349-d4e7b6382da5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:09.068111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb4b94e4-8a62-4cb6-9349-d4e7b6382da5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:09.069239 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb4b94e4-8a62-4cb6-9349-d4e7b6382da5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:09.069670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb4b94e4-8a62-4cb6-9349-d4e7b6382da5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:09.074989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:09.081861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-2a2835e6-957f-43b6-9350-44a7460b8ad4 req-b18c371e-8eef-4a34-8477-e448dd7289f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ee86d8-d269-493f-a24a-32c664d277d9", "tag": "f1dd3161-ede7-45be-a32c-472d4a0a6a58"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:09.096219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-2a2835e6-957f-43b6-9350-44a7460b8ad4 req-b18c371e-8eef-4a34-8477-e448dd7289f8 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:09.097245 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-2a2835e6-957f-43b6-9350-44a7460b8ad4 req-b18c371e-8eef-4a34-8477-e448dd7289f8 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:09.098113 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-2a2835e6-957f-43b6-9350-44a7460b8ad4 req-b18c371e-8eef-4a34-8477-e448dd7289f8 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:09.119336 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-2a2835e6-957f-43b6-9350-44a7460b8ad4 req-b18c371e-8eef-4a34-8477-e448dd7289f8 service nova] Creating event network-changed:f1dd3161-ede7-45be-a32c-472d4a0a6a58 for instance b5ee86d8-d269-493f-a24a-32c664d277d9 on hv-cinder-81966 Aug 30 01:58:09.124984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-2a2835e6-957f-43b6-9350-44a7460b8ad4 req-b18c371e-8eef-4a34-8477-e448dd7289f8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047802 Aug 30 01:58:09.125577 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 163/326] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:58:09.132227 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2105ab91-129a-46da-ba1a-aea230094975 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:09.132967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2105ab91-129a-46da-ba1a-aea230094975 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:09.141787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2105ab91-129a-46da-ba1a-aea230094975 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:09.142473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2105ab91-129a-46da-ba1a-aea230094975 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:09.143062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2105ab91-129a-46da-ba1a-aea230094975 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:09.143955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2105ab91-129a-46da-ba1a-aea230094975 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:09.144637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2105ab91-129a-46da-ba1a-aea230094975 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:09.145209 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2105ab91-129a-46da-ba1a-aea230094975 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:09.152380 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:09.285554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-eb4b94e4-8a62-4cb6-9349-d4e7b6382da5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:09.299331 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2105ab91-129a-46da-ba1a-aea230094975 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:09.301977 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-eb4b94e4-8a62-4cb6-9349-d4e7b6382da5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.246498 Aug 30 01:58:09.303206 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 164/327] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:09 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:09.323506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2105ab91-129a-46da-ba1a-aea230094975 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.196525 Aug 30 01:58:09.324361 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 164/328] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:09 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:09.726112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-24cb1194-f124-4ef0-8de4-dcd7956d022e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:09.726712 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-24cb1194-f124-4ef0-8de4-dcd7956d022e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:09.732660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-24cb1194-f124-4ef0-8de4-dcd7956d022e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:09.733131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-24cb1194-f124-4ef0-8de4-dcd7956d022e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:09.733552 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-24cb1194-f124-4ef0-8de4-dcd7956d022e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:09.734224 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-24cb1194-f124-4ef0-8de4-dcd7956d022e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:09.734668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-24cb1194-f124-4ef0-8de4-dcd7956d022e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:09.735082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-24cb1194-f124-4ef0-8de4-dcd7956d022e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:09.864673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-24cb1194-f124-4ef0-8de4-dcd7956d022e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:09.872738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-24cb1194-f124-4ef0-8de4-dcd7956d022e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.150937 Aug 30 01:58:09.873290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 165/329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:09 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:10.324448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-77c45c1a-83f5-46ca-b6aa-3e368fa7a370 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:10.325054 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-77c45c1a-83f5-46ca-b6aa-3e368fa7a370 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:10.331293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77c45c1a-83f5-46ca-b6aa-3e368fa7a370 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:10.331778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77c45c1a-83f5-46ca-b6aa-3e368fa7a370 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:10.332205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77c45c1a-83f5-46ca-b6aa-3e368fa7a370 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:10.332902 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77c45c1a-83f5-46ca-b6aa-3e368fa7a370 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:10.333352 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77c45c1a-83f5-46ca-b6aa-3e368fa7a370 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:10.333772 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77c45c1a-83f5-46ca-b6aa-3e368fa7a370 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:10.345369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-351b7dd1-3feb-4242-93e9-2a7b74da779a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:10.345969 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-351b7dd1-3feb-4242-93e9-2a7b74da779a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:10.352706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-351b7dd1-3feb-4242-93e9-2a7b74da779a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:10.353184 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-351b7dd1-3feb-4242-93e9-2a7b74da779a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:10.353610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-351b7dd1-3feb-4242-93e9-2a7b74da779a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:10.354292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-351b7dd1-3feb-4242-93e9-2a7b74da779a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:10.354738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-351b7dd1-3feb-4242-93e9-2a7b74da779a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:10.355153 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-351b7dd1-3feb-4242-93e9-2a7b74da779a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:10.493911 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-77c45c1a-83f5-46ca-b6aa-3e368fa7a370 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:10.501791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-77c45c1a-83f5-46ca-b6aa-3e368fa7a370 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1312 microversion: 2.1 time: 0.181056 Aug 30 01:58:10.502361 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 165/330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:10 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:10.736965 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-351b7dd1-3feb-4242-93e9-2a7b74da779a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:10.745114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-351b7dd1-3feb-4242-93e9-2a7b74da779a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.403567 Aug 30 01:58:10.745603 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 166/331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:10 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:10.895109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fc66856d-221a-4b99-b8ad-b5e581679d21 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:10.895710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fc66856d-221a-4b99-b8ad-b5e581679d21 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:10.903160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc66856d-221a-4b99-b8ad-b5e581679d21 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:10.903710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc66856d-221a-4b99-b8ad-b5e581679d21 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:10.904151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc66856d-221a-4b99-b8ad-b5e581679d21 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:10.904867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc66856d-221a-4b99-b8ad-b5e581679d21 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:10.905310 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc66856d-221a-4b99-b8ad-b5e581679d21 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:10.905729 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc66856d-221a-4b99-b8ad-b5e581679d21 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:11.038979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fc66856d-221a-4b99-b8ad-b5e581679d21 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:11.047826 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fc66856d-221a-4b99-b8ad-b5e581679d21 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.156479 Aug 30 01:58:11.048527 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 166/332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:10 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:11.523388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-75ed28a9-46f8-4491-91a7-434d80ec6d0f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:11.524152 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-75ed28a9-46f8-4491-91a7-434d80ec6d0f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:11.530044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ed28a9-46f8-4491-91a7-434d80ec6d0f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:11.530519 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ed28a9-46f8-4491-91a7-434d80ec6d0f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:11.530945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ed28a9-46f8-4491-91a7-434d80ec6d0f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:11.531634 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ed28a9-46f8-4491-91a7-434d80ec6d0f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:11.532080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ed28a9-46f8-4491-91a7-434d80ec6d0f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:11.532548 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ed28a9-46f8-4491-91a7-434d80ec6d0f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:11.667504 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-75ed28a9-46f8-4491-91a7-434d80ec6d0f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:11.675324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-75ed28a9-46f8-4491-91a7-434d80ec6d0f tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1496 microversion: 2.1 time: 0.156257 Aug 30 01:58:11.675922 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 167/333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:11 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:11.765164 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ad89faa4-6df7-4376-9c8b-4e377daf2fd9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:11.765776 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ad89faa4-6df7-4376-9c8b-4e377daf2fd9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:11.772751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad89faa4-6df7-4376-9c8b-4e377daf2fd9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:11.773160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad89faa4-6df7-4376-9c8b-4e377daf2fd9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:11.773595 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad89faa4-6df7-4376-9c8b-4e377daf2fd9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:11.774285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad89faa4-6df7-4376-9c8b-4e377daf2fd9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:11.774736 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad89faa4-6df7-4376-9c8b-4e377daf2fd9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:11.775157 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad89faa4-6df7-4376-9c8b-4e377daf2fd9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:11.931845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ad89faa4-6df7-4376-9c8b-4e377daf2fd9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:11.940383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ad89faa4-6df7-4376-9c8b-4e377daf2fd9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.179013 Aug 30 01:58:11.952889 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 167/334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:11 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:12.069549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1df96e07-5887-4060-bb1d-b388e1a84a84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:12.070360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1df96e07-5887-4060-bb1d-b388e1a84a84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:12.076172 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1df96e07-5887-4060-bb1d-b388e1a84a84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:12.076686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1df96e07-5887-4060-bb1d-b388e1a84a84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:12.077119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1df96e07-5887-4060-bb1d-b388e1a84a84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:12.077809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1df96e07-5887-4060-bb1d-b388e1a84a84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:12.078260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1df96e07-5887-4060-bb1d-b388e1a84a84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:12.078681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1df96e07-5887-4060-bb1d-b388e1a84a84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:12.213464 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1df96e07-5887-4060-bb1d-b388e1a84a84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:12.221468 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1df96e07-5887-4060-bb1d-b388e1a84a84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.156142 Aug 30 01:58:12.222045 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 168/335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:12 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:12.259191 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6b0c999f-bcf7-4c61-9fe7-60b955507fc7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:12.259682 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6b0c999f-bcf7-4c61-9fe7-60b955507fc7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:12.265664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0c999f-bcf7-4c61-9fe7-60b955507fc7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:12.266141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0c999f-bcf7-4c61-9fe7-60b955507fc7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:12.266566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0c999f-bcf7-4c61-9fe7-60b955507fc7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:12.267263 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0c999f-bcf7-4c61-9fe7-60b955507fc7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:12.267704 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0c999f-bcf7-4c61-9fe7-60b955507fc7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:12.268115 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0c999f-bcf7-4c61-9fe7-60b955507fc7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:12.292976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6b0c999f-bcf7-4c61-9fe7-60b955507fc7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:58:12.379566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6b0c999f-bcf7-4c61-9fe7-60b955507fc7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 204 len: 0 microversion: 2.1 time: 0.124579 Aug 30 01:58:12.380619 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 168/336] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 01:58:12 2022] DELETE /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:58:12.389178 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b05eaf6a-408a-41bd-8bd6-5ecaafdf413d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:12.389778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b05eaf6a-408a-41bd-8bd6-5ecaafdf413d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:12.395500 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b05eaf6a-408a-41bd-8bd6-5ecaafdf413d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:12.395974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b05eaf6a-408a-41bd-8bd6-5ecaafdf413d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:12.396516 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b05eaf6a-408a-41bd-8bd6-5ecaafdf413d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:12.397196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b05eaf6a-408a-41bd-8bd6-5ecaafdf413d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:12.397636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b05eaf6a-408a-41bd-8bd6-5ecaafdf413d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:12.398231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b05eaf6a-408a-41bd-8bd6-5ecaafdf413d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:12.545272 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b05eaf6a-408a-41bd-8bd6-5ecaafdf413d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:12.554570 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b05eaf6a-408a-41bd-8bd6-5ecaafdf413d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1502 microversion: 2.1 time: 0.169280 Aug 30 01:58:12.555152 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 169/337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:12 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:12.962697 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ea425c6d-bfdb-4d5e-9bd6-224e44197c1f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:12.963557 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ea425c6d-bfdb-4d5e-9bd6-224e44197c1f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:12.970623 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea425c6d-bfdb-4d5e-9bd6-224e44197c1f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:12.971107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea425c6d-bfdb-4d5e-9bd6-224e44197c1f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:12.971537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea425c6d-bfdb-4d5e-9bd6-224e44197c1f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:12.972230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea425c6d-bfdb-4d5e-9bd6-224e44197c1f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:12.972848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea425c6d-bfdb-4d5e-9bd6-224e44197c1f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:12.973442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea425c6d-bfdb-4d5e-9bd6-224e44197c1f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:13.138913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ea425c6d-bfdb-4d5e-9bd6-224e44197c1f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:13.148225 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ea425c6d-bfdb-4d5e-9bd6-224e44197c1f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.190731 Aug 30 01:58:13.149002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 169/338] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:12 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:13.244077 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4b911305-41d3-4390-b535-a252fea48043 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:13.261524 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4b911305-41d3-4390-b535-a252fea48043 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:13.281567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b911305-41d3-4390-b535-a252fea48043 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:13.282058 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b911305-41d3-4390-b535-a252fea48043 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:13.282498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b911305-41d3-4390-b535-a252fea48043 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:13.283204 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b911305-41d3-4390-b535-a252fea48043 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:13.283661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b911305-41d3-4390-b535-a252fea48043 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:13.284083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b911305-41d3-4390-b535-a252fea48043 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:13.420543 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4b911305-41d3-4390-b535-a252fea48043 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:13.428150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4b911305-41d3-4390-b535-a252fea48043 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.189918 Aug 30 01:58:13.428742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 170/339] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:13 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:13.575116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ed5db9ad-1818-4bba-8c15-55df4b2c84fc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:13.575731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ed5db9ad-1818-4bba-8c15-55df4b2c84fc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:13.581880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed5db9ad-1818-4bba-8c15-55df4b2c84fc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:13.582362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed5db9ad-1818-4bba-8c15-55df4b2c84fc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:13.582795 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed5db9ad-1818-4bba-8c15-55df4b2c84fc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:13.583485 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed5db9ad-1818-4bba-8c15-55df4b2c84fc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:13.583989 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed5db9ad-1818-4bba-8c15-55df4b2c84fc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:13.584987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed5db9ad-1818-4bba-8c15-55df4b2c84fc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:13.726754 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ed5db9ad-1818-4bba-8c15-55df4b2c84fc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:13.735309 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ed5db9ad-1818-4bba-8c15-55df4b2c84fc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1502 microversion: 2.1 time: 0.163935 Aug 30 01:58:13.744680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 170/340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:13 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:14.170561 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-34c741ce-4b55-4808-b093-5e370af7d2c2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:14.171160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-34c741ce-4b55-4808-b093-5e370af7d2c2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:14.177036 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-34c741ce-4b55-4808-b093-5e370af7d2c2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:14.177504 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-34c741ce-4b55-4808-b093-5e370af7d2c2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:14.178552 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-34c741ce-4b55-4808-b093-5e370af7d2c2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:14.179297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-34c741ce-4b55-4808-b093-5e370af7d2c2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:14.179742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-34c741ce-4b55-4808-b093-5e370af7d2c2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:14.180156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-34c741ce-4b55-4808-b093-5e370af7d2c2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:14.307283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-34c741ce-4b55-4808-b093-5e370af7d2c2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:14.314792 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-34c741ce-4b55-4808-b093-5e370af7d2c2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.148063 Aug 30 01:58:14.315352 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 171/341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:14 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:14.448336 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-afa8dc2d-0431-43d3-bf9d-ff46a16e1ae4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:14.448852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-afa8dc2d-0431-43d3-bf9d-ff46a16e1ae4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:14.455179 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afa8dc2d-0431-43d3-bf9d-ff46a16e1ae4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:14.455657 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afa8dc2d-0431-43d3-bf9d-ff46a16e1ae4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:14.456091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afa8dc2d-0431-43d3-bf9d-ff46a16e1ae4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:14.456804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afa8dc2d-0431-43d3-bf9d-ff46a16e1ae4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:14.457254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afa8dc2d-0431-43d3-bf9d-ff46a16e1ae4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:14.457679 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afa8dc2d-0431-43d3-bf9d-ff46a16e1ae4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:14.581038 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-afa8dc2d-0431-43d3-bf9d-ff46a16e1ae4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:14.589084 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-afa8dc2d-0431-43d3-bf9d-ff46a16e1ae4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.144736 Aug 30 01:58:14.589643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 171/342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:14 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:14.756901 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5e4b1fbb-ccf4-41dc-b931-41b4348d05d6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:14.757508 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5e4b1fbb-ccf4-41dc-b931-41b4348d05d6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:14.763372 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4b1fbb-ccf4-41dc-b931-41b4348d05d6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:14.763853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4b1fbb-ccf4-41dc-b931-41b4348d05d6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:14.764306 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4b1fbb-ccf4-41dc-b931-41b4348d05d6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:14.764998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4b1fbb-ccf4-41dc-b931-41b4348d05d6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:14.765445 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4b1fbb-ccf4-41dc-b931-41b4348d05d6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:14.765865 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4b1fbb-ccf4-41dc-b931-41b4348d05d6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:14.983451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5e4b1fbb-ccf4-41dc-b931-41b4348d05d6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:14.991713 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5e4b1fbb-ccf4-41dc-b931-41b4348d05d6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1502 microversion: 2.1 time: 0.239524 Aug 30 01:58:14.992292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 172/343] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:14 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:15.254853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-d81fbd03-777b-405b-91fd-224098cde1a3 req-2d74d64b-9d3b-4404-82ef-a47c3e7ae177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90", "name": "network-vif-deleted", "tag": "25bc12e7-b1b1-4e1b-b92a-75eb4e0ea2f0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:15.255464 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1245370780", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "networks": [{"uuid": "f9f80911-cdea-4592-abdd-3859ccadc0fb"}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:15.267028 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d81fbd03-777b-405b-91fd-224098cde1a3 req-2d74d64b-9d3b-4404-82ef-a47c3e7ae177 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:15.267426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d81fbd03-777b-405b-91fd-224098cde1a3 req-2d74d64b-9d3b-4404-82ef-a47c3e7ae177 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:15.267860 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d81fbd03-777b-405b-91fd-224098cde1a3 req-2d74d64b-9d3b-4404-82ef-a47c3e7ae177 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:15.280309 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-d81fbd03-777b-405b-91fd-224098cde1a3 req-2d74d64b-9d3b-4404-82ef-a47c3e7ae177 service nova] Creating event network-vif-deleted:25bc12e7-b1b1-4e1b-b92a-75eb4e0ea2f0 for instance 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 on hv-cinder-81966 Aug 30 01:58:15.285078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-d81fbd03-777b-405b-91fd-224098cde1a3 req-2d74d64b-9d3b-4404-82ef-a47c3e7ae177 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034129 Aug 30 01:58:15.285947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 173/344] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:58:15.314920 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] validate_networks() for [('f9f80911-cdea-4592-abdd-3859ccadc0fb', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:58:15.335938 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-07bcdc52-97c7-4716-8ba3-866915d9b235 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:15.336661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-07bcdc52-97c7-4716-8ba3-866915d9b235 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:15.342797 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-07bcdc52-97c7-4716-8ba3-866915d9b235 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:15.343274 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-07bcdc52-97c7-4716-8ba3-866915d9b235 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:15.343706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-07bcdc52-97c7-4716-8ba3-866915d9b235 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:15.344429 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-07bcdc52-97c7-4716-8ba3-866915d9b235 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:15.344881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-07bcdc52-97c7-4716-8ba3-866915d9b235 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:15.345302 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-07bcdc52-97c7-4716-8ba3-866915d9b235 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:15.493251 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-07bcdc52-97c7-4716-8ba3-866915d9b235 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:15.500160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:15.503318 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-07bcdc52-97c7-4716-8ba3-866915d9b235 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.171838 Aug 30 01:58:15.504080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 174/345] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:15 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:15.611542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e2320796-c5ed-417a-a38a-0c33645eff54 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:15.612150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e2320796-c5ed-417a-a38a-0c33645eff54 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:15.613992 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=6 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:15.619925 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e2320796-c5ed-417a-a38a-0c33645eff54 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:15.620447 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e2320796-c5ed-417a-a38a-0c33645eff54 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:15.620881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e2320796-c5ed-417a-a38a-0c33645eff54 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:15.621568 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e2320796-c5ed-417a-a38a-0c33645eff54 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:15.622019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e2320796-c5ed-417a-a38a-0c33645eff54 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:15.623067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e2320796-c5ed-417a-a38a-0c33645eff54 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:15.715542 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:58:15.716042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:58:15.716444 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:58:15.716877 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:58:15.717276 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:58:15.734971 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:15.735449 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:15.736052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:15.736966 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:15.737619 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:15.738035 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:15.759049 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Getting quotas for project 4d07d38e84224c9282dea262e712e4e3. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:58:15.766382 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Getting quotas for user 0646d81951fa4353bdfb59048b498652 and project 4d07d38e84224c9282dea262e712e4e3. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:58:15.772416 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e2320796-c5ed-417a-a38a-0c33645eff54 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:15.780197 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e2320796-c5ed-417a-a38a-0c33645eff54 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.173730 Aug 30 01:58:15.780997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 175/346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:15 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:15.786455 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:58:15.789410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:58:15.834409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-27983809-6755-4e95-92cb-97337691b98e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583565 Aug 30 01:58:15.835028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 172/347] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:58:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:58:15.845648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5c787086-fc71-416d-b7c5-26f1e968d8c7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:15.846249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5c787086-fc71-416d-b7c5-26f1e968d8c7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:15.904158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5c787086-fc71-416d-b7c5-26f1e968d8c7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:15.911460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5c787086-fc71-416d-b7c5-26f1e968d8c7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1219 microversion: 2.1 time: 0.069679 Aug 30 01:58:15.912534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 176/348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:15 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:16.013264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:16.014017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:16.023612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:16.024090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:16.024541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:16.025225 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:16.025669 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:16.026087 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:16.058257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:16.058687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:16.059085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:16.059577 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lazy-loading 'fault' on Instance uuid 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:58:16.111588 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:16.125827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8ad46ee7-2344-495a-8dd1-b462ceb4b5fd tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 200 len: 1302 microversion: 2.1 time: 0.116508 Aug 30 01:58:16.127076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 173/349] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:16 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 1302 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:16.524274 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f8da0e02-e9f5-4efc-9535-5e275da05635 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:16.525087 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f8da0e02-e9f5-4efc-9535-5e275da05635 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:16.531031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8da0e02-e9f5-4efc-9535-5e275da05635 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:16.531507 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8da0e02-e9f5-4efc-9535-5e275da05635 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:16.531939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8da0e02-e9f5-4efc-9535-5e275da05635 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:16.532664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8da0e02-e9f5-4efc-9535-5e275da05635 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:16.533113 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8da0e02-e9f5-4efc-9535-5e275da05635 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:16.533537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8da0e02-e9f5-4efc-9535-5e275da05635 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:16.664525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f8da0e02-e9f5-4efc-9535-5e275da05635 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:16.672532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f8da0e02-e9f5-4efc-9535-5e275da05635 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.152187 Aug 30 01:58:16.673279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 177/350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:16 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:16.801522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-40dfad8d-5be7-4132-be10-cbe9ff1ca952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:16.802123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-40dfad8d-5be7-4132-be10-cbe9ff1ca952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:16.808914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40dfad8d-5be7-4132-be10-cbe9ff1ca952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:16.809373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40dfad8d-5be7-4132-be10-cbe9ff1ca952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:16.809801 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40dfad8d-5be7-4132-be10-cbe9ff1ca952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:16.810470 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40dfad8d-5be7-4132-be10-cbe9ff1ca952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:16.810913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40dfad8d-5be7-4132-be10-cbe9ff1ca952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:16.811328 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40dfad8d-5be7-4132-be10-cbe9ff1ca952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:16.932813 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d7a0802f-7978-418f-a986-ca6d542022b5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:16.933425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d7a0802f-7978-418f-a986-ca6d542022b5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:16.939218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7a0802f-7978-418f-a986-ca6d542022b5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:16.939728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7a0802f-7978-418f-a986-ca6d542022b5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:16.940174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7a0802f-7978-418f-a986-ca6d542022b5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:16.940412 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-40dfad8d-5be7-4132-be10-cbe9ff1ca952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:16.940877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7a0802f-7978-418f-a986-ca6d542022b5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:16.941334 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7a0802f-7978-418f-a986-ca6d542022b5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:16.941755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7a0802f-7978-418f-a986-ca6d542022b5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:16.948988 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-40dfad8d-5be7-4132-be10-cbe9ff1ca952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.151195 Aug 30 01:58:16.949578 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 174/351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:16 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:17.002125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d7a0802f-7978-418f-a986-ca6d542022b5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:17.010466 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d7a0802f-7978-418f-a986-ca6d542022b5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1271 microversion: 2.1 time: 0.081533 Aug 30 01:58:17.011020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 178/352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:16 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:17.148827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:17.149515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:17.155509 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:17.156111 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:17.156814 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:17.157640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:17.158194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:17.158877 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:17.174855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] HTTP exception thrown: Instance 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 could not be found. Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Request method failure captured: Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 HTTP/1.1 Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW6Ssrs6klDso8ND_xUXZ5cf4wjKWbCztVzX9_EcVOIAsHifwH-wamOveh7KX-OlKWOSVPtwzF7MgCKS0UVV96D1ApsFYJjgAG5BoWPUCrRuTQuu8R79PLbH_FFytSESTidXf_mtDoyRtpa8uSRBG47QbBFA7IG1tZCV3DaoQQdZxmU Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 154f5229567c4023adcbe0069a9b4abb Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesActionsTest-1506369466 Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 01:58:17.176921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/154f5229567c4023adcbe0069a9b4abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/154f5229567c4023adcbe0069a9b4abb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/154f5229567c4023adcbe0069a9b4abb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_154f5229567c4023adcbe0069a9b4abb"}]}] Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesActionsTest-1506369466 Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 154f5229567c4023adcbe0069a9b4abb Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesActionsTest-1506369466 Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesActionsTest-1506369466-project Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: aa5c9d73b6bb4b32b2da9386273690bb Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesActionsTest-1506369466-project Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 could not be found. Aug 30 01:58:17.179364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90'} Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 could not be found. Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:58:17.180287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 could not be found. Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 could not be found. Aug 30 01:58:17.182670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:58:17.184585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Returning 404 to user: Instance 0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:58:17.184585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3266ff4e-c3be-4535-a7c0-fb3e427d7fe3 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90" status: 404 len: 111 microversion: 2.1 time: 0.037218 Aug 30 01:58:17.184585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 175/353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:17 2022] GET /compute/v2.1/servers/0ffe4b7d-c4cf-468c-b04c-126d4ed6ae90 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:58:17.304024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1054063932", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "networks": [{"uuid": "223989b8-81d0-4cea-81c0-85c9576407f1"}]}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:17.358697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.network.neutron [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] validate_networks() for [('223989b8-81d0-4cea-81c0-85c9576407f1', None, None, None, None, None)] {{(pid=120391) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:58:17.692496 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1d7f1bed-b749-4e8d-88e2-f42e7e7efe37 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:17.693311 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1d7f1bed-b749-4e8d-88e2-f42e7e7efe37 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:17.699762 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bed-b749-4e8d-88e2-f42e7e7efe37 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:17.699913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bed-b749-4e8d-88e2-f42e7e7efe37 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:17.700317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bed-b749-4e8d-88e2-f42e7e7efe37 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:17.701011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bed-b749-4e8d-88e2-f42e7e7efe37 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:17.701494 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bed-b749-4e8d-88e2-f42e7e7efe37 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:17.701916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bed-b749-4e8d-88e2-f42e7e7efe37 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:17.833482 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1d7f1bed-b749-4e8d-88e2-f42e7e7efe37 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:17.842198 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1d7f1bed-b749-4e8d-88e2-f42e7e7efe37 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.153523 Aug 30 01:58:17.842757 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 176/354] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:17 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:17.921479 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Flavor limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:58:17.921968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Image limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:58:17.922346 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Flavor pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:58:17.922745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Image pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:58:17.923148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:58:17.931648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:17.932126 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:17.932587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:17.933349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:17.933793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:17.934206 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:17.951126 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Getting quotas for project 154f5229567c4023adcbe0069a9b4abb. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:58:17.955023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Getting quotas for user aa5c9d73b6bb4b32b2da9386273690bb and project 154f5229567c4023adcbe0069a9b4abb. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:58:17.968472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Going to run 1 instances... {{(pid=120391) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:58:17.969970 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-159009b5-2e2c-493e-995a-d4bd11ac1838 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:17.970595 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-159009b5-2e2c-493e-995a-d4bd11ac1838 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:17.971089 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:58:17.977185 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-159009b5-2e2c-493e-995a-d4bd11ac1838 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:17.977665 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-159009b5-2e2c-493e-995a-d4bd11ac1838 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:17.978090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-159009b5-2e2c-493e-995a-d4bd11ac1838 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:17.978772 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-159009b5-2e2c-493e-995a-d4bd11ac1838 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:17.979214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-159009b5-2e2c-493e-995a-d4bd11ac1838 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:17.979809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-159009b5-2e2c-493e-995a-d4bd11ac1838 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:18.018593 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-73a5f5fd-c79e-4fa8-a9a1-95e473302467 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719610 Aug 30 01:58:18.019860 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 179/355] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:58:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:58:18.034126 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6e54f462-f556-48db-b610-c123a37120da tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:18.035114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6e54f462-f556-48db-b610-c123a37120da tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:18.045758 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e54f462-f556-48db-b610-c123a37120da tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:18.046245 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e54f462-f556-48db-b610-c123a37120da tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:18.046750 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e54f462-f556-48db-b610-c123a37120da tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:18.047428 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e54f462-f556-48db-b610-c123a37120da tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:18.047784 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e54f462-f556-48db-b610-c123a37120da tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:18.048201 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6e54f462-f556-48db-b610-c123a37120da tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:18.162946 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-159009b5-2e2c-493e-995a-d4bd11ac1838 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:18.171567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-159009b5-2e2c-493e-995a-d4bd11ac1838 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.205480 Aug 30 01:58:18.173669 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 177/356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:17 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:18.178854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-85d1e08b-cb42-4823-87bf-612be18b14d7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:18.179759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-85d1e08b-cb42-4823-87bf-612be18b14d7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:18.241409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-85d1e08b-cb42-4823-87bf-612be18b14d7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:18.248948 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-85d1e08b-cb42-4823-87bf-612be18b14d7 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1214 microversion: 2.1 time: 0.073816 Aug 30 01:58:18.249726 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 178/357] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:18 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:18.329715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6e54f462-f556-48db-b610-c123a37120da tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:18.338386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6e54f462-f556-48db-b610-c123a37120da tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.308585 Aug 30 01:58:18.339563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 180/358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:18 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:18.830699 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-8edc5eb5-79b7-45e1-979e-c20391947301 req-8bae1d67-6201-4f12-b44b-4e9bee2a441e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33e0127-93b8-4cdb-913a-5863f403890e", "tag": "d2f0275f-d1ef-439d-83db-d9568b347aca"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:18.843012 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8edc5eb5-79b7-45e1-979e-c20391947301 req-8bae1d67-6201-4f12-b44b-4e9bee2a441e service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:18.844300 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8edc5eb5-79b7-45e1-979e-c20391947301 req-8bae1d67-6201-4f12-b44b-4e9bee2a441e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:18.844898 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8edc5eb5-79b7-45e1-979e-c20391947301 req-8bae1d67-6201-4f12-b44b-4e9bee2a441e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:18.856513 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-8edc5eb5-79b7-45e1-979e-c20391947301 req-8bae1d67-6201-4f12-b44b-4e9bee2a441e service nova] Creating event network-changed:d2f0275f-d1ef-439d-83db-d9568b347aca for instance e33e0127-93b8-4cdb-913a-5863f403890e on hv-cinder-81966 Aug 30 01:58:18.862296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-8edc5eb5-79b7-45e1-979e-c20391947301 req-8bae1d67-6201-4f12-b44b-4e9bee2a441e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035249 Aug 30 01:58:18.863090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 179/359] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:58:18.868596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c0b10f6a-6bc3-4160-bd7b-6ed46a1fe013 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:18.869388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c0b10f6a-6bc3-4160-bd7b-6ed46a1fe013 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:18.877746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c0b10f6a-6bc3-4160-bd7b-6ed46a1fe013 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:18.878682 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c0b10f6a-6bc3-4160-bd7b-6ed46a1fe013 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:18.879125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c0b10f6a-6bc3-4160-bd7b-6ed46a1fe013 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:18.880160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c0b10f6a-6bc3-4160-bd7b-6ed46a1fe013 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:18.880681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c0b10f6a-6bc3-4160-bd7b-6ed46a1fe013 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:18.881105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c0b10f6a-6bc3-4160-bd7b-6ed46a1fe013 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:19.039151 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c0b10f6a-6bc3-4160-bd7b-6ed46a1fe013 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:19.047279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c0b10f6a-6bc3-4160-bd7b-6ed46a1fe013 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.184837 Aug 30 01:58:19.047957 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 181/360] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:18 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:19.195359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-83f6774f-9af7-4856-b474-e2961a9ccc44 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:19.196044 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-83f6774f-9af7-4856-b474-e2961a9ccc44 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:19.202109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83f6774f-9af7-4856-b474-e2961a9ccc44 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:19.202580 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83f6774f-9af7-4856-b474-e2961a9ccc44 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:19.203005 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83f6774f-9af7-4856-b474-e2961a9ccc44 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:19.203683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83f6774f-9af7-4856-b474-e2961a9ccc44 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:19.204123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83f6774f-9af7-4856-b474-e2961a9ccc44 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:19.204564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-83f6774f-9af7-4856-b474-e2961a9ccc44 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:19.270933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e6eab23f-6443-4eef-aca5-c003fbd653e6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:19.272024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e6eab23f-6443-4eef-aca5-c003fbd653e6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:19.277892 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6eab23f-6443-4eef-aca5-c003fbd653e6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:19.278371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6eab23f-6443-4eef-aca5-c003fbd653e6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:19.278796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6eab23f-6443-4eef-aca5-c003fbd653e6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:19.279473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6eab23f-6443-4eef-aca5-c003fbd653e6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:19.279916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6eab23f-6443-4eef-aca5-c003fbd653e6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:19.280354 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6eab23f-6443-4eef-aca5-c003fbd653e6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:19.336569 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-83f6774f-9af7-4856-b474-e2961a9ccc44 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:19.344433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e6eab23f-6443-4eef-aca5-c003fbd653e6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:19.344881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-83f6774f-9af7-4856-b474-e2961a9ccc44 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.153650 Aug 30 01:58:19.345515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 180/361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:19 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:19.352223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e6eab23f-6443-4eef-aca5-c003fbd653e6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1266 microversion: 2.1 time: 0.085063 Aug 30 01:58:19.353283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 182/362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:19 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:19.359229 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8d2060d8-4870-4e23-a3c9-368193f479c8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:19.359918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8d2060d8-4870-4e23-a3c9-368193f479c8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:19.366254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d2060d8-4870-4e23-a3c9-368193f479c8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:19.366738 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d2060d8-4870-4e23-a3c9-368193f479c8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:19.367167 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d2060d8-4870-4e23-a3c9-368193f479c8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:19.367850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d2060d8-4870-4e23-a3c9-368193f479c8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:19.368324 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d2060d8-4870-4e23-a3c9-368193f479c8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:19.368745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d2060d8-4870-4e23-a3c9-368193f479c8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:19.498725 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8d2060d8-4870-4e23-a3c9-368193f479c8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:19.500999 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:19.508461 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8d2060d8-4870-4e23-a3c9-368193f479c8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.153039 Aug 30 01:58:19.509003 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 181/363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:19 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:20.067780 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-84c9d738-0106-4fde-94e1-6bc312f5b719 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:20.069022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-84c9d738-0106-4fde-94e1-6bc312f5b719 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:20.074989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84c9d738-0106-4fde-94e1-6bc312f5b719 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:20.075488 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84c9d738-0106-4fde-94e1-6bc312f5b719 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:20.075916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84c9d738-0106-4fde-94e1-6bc312f5b719 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:20.076622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84c9d738-0106-4fde-94e1-6bc312f5b719 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:20.077068 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84c9d738-0106-4fde-94e1-6bc312f5b719 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:20.077481 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84c9d738-0106-4fde-94e1-6bc312f5b719 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:20.079948 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:20.206594 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-84c9d738-0106-4fde-94e1-6bc312f5b719 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:20.214188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-84c9d738-0106-4fde-94e1-6bc312f5b719 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.150247 Aug 30 01:58:20.214742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 183/364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:20 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:20.367854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9ff79893-4b5a-401f-b9fd-70b04f479549 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:20.369004 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9ff79893-4b5a-401f-b9fd-70b04f479549 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:20.371775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:20.374002 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ddde4b0d-2e18-4e90-81dd-7b9ab4be76f6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:20.374721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ddde4b0d-2e18-4e90-81dd-7b9ab4be76f6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:20.377814 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ff79893-4b5a-401f-b9fd-70b04f479549 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:20.378757 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ff79893-4b5a-401f-b9fd-70b04f479549 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:20.379559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ff79893-4b5a-401f-b9fd-70b04f479549 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:20.380387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ff79893-4b5a-401f-b9fd-70b04f479549 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:20.380840 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ff79893-4b5a-401f-b9fd-70b04f479549 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:20.381258 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ff79893-4b5a-401f-b9fd-70b04f479549 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:20.381381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ddde4b0d-2e18-4e90-81dd-7b9ab4be76f6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:20.381853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ddde4b0d-2e18-4e90-81dd-7b9ab4be76f6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:20.382276 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ddde4b0d-2e18-4e90-81dd-7b9ab4be76f6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:20.382992 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ddde4b0d-2e18-4e90-81dd-7b9ab4be76f6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:20.383467 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ddde4b0d-2e18-4e90-81dd-7b9ab4be76f6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:20.384072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ddde4b0d-2e18-4e90-81dd-7b9ab4be76f6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:20.451160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ddde4b0d-2e18-4e90-81dd-7b9ab4be76f6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:20.458736 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ddde4b0d-2e18-4e90-81dd-7b9ab4be76f6 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1266 microversion: 2.1 time: 0.088979 Aug 30 01:58:20.459298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 184/365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:20 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:20.527553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9ff79893-4b5a-401f-b9fd-70b04f479549 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:20.528957 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cbcbdf8a-7b45-40af-8e7d-9f57442b032d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:20.529746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cbcbdf8a-7b45-40af-8e7d-9f57442b032d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:20.535728 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9ff79893-4b5a-401f-b9fd-70b04f479549 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.172581 Aug 30 01:58:20.536004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbcbdf8a-7b45-40af-8e7d-9f57442b032d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:20.536345 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 182/366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:20 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:20.536523 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbcbdf8a-7b45-40af-8e7d-9f57442b032d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:20.537528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbcbdf8a-7b45-40af-8e7d-9f57442b032d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:20.538292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbcbdf8a-7b45-40af-8e7d-9f57442b032d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:20.538741 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbcbdf8a-7b45-40af-8e7d-9f57442b032d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:20.539157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbcbdf8a-7b45-40af-8e7d-9f57442b032d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:20.680180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cbcbdf8a-7b45-40af-8e7d-9f57442b032d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:20.687718 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cbcbdf8a-7b45-40af-8e7d-9f57442b032d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.162787 Aug 30 01:58:20.688286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 185/367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:20 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:21.235068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e0a81b87-c975-40a1-999a-77d2e4d6011e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:21.235705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e0a81b87-c975-40a1-999a-77d2e4d6011e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:21.241697 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a81b87-c975-40a1-999a-77d2e4d6011e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:21.242180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a81b87-c975-40a1-999a-77d2e4d6011e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:21.242611 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a81b87-c975-40a1-999a-77d2e4d6011e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:21.243288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a81b87-c975-40a1-999a-77d2e4d6011e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:21.243735 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a81b87-c975-40a1-999a-77d2e4d6011e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:21.244153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0a81b87-c975-40a1-999a-77d2e4d6011e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:21.371690 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e0a81b87-c975-40a1-999a-77d2e4d6011e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:21.380034 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e0a81b87-c975-40a1-999a-77d2e4d6011e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.148843 Aug 30 01:58:21.381190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 183/368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:21 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:21.478912 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-54479c2d-8a67-4e13-a1d2-1e14a85ec90b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:21.479514 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-54479c2d-8a67-4e13-a1d2-1e14a85ec90b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:21.485465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-54479c2d-8a67-4e13-a1d2-1e14a85ec90b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:21.485891 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-54479c2d-8a67-4e13-a1d2-1e14a85ec90b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:21.486323 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-54479c2d-8a67-4e13-a1d2-1e14a85ec90b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:21.487001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-54479c2d-8a67-4e13-a1d2-1e14a85ec90b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:21.487448 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-54479c2d-8a67-4e13-a1d2-1e14a85ec90b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:21.487867 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-54479c2d-8a67-4e13-a1d2-1e14a85ec90b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:21.550443 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-54479c2d-8a67-4e13-a1d2-1e14a85ec90b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:21.556932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-56911d31-08ab-426a-a9b4-8533eae80589 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:21.557532 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-56911d31-08ab-426a-a9b4-8533eae80589 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:21.558614 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-54479c2d-8a67-4e13-a1d2-1e14a85ec90b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1272 microversion: 2.1 time: 0.083649 Aug 30 01:58:21.559175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 186/369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:21 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:21.563443 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56911d31-08ab-426a-a9b4-8533eae80589 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:21.563911 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56911d31-08ab-426a-a9b4-8533eae80589 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:21.564376 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56911d31-08ab-426a-a9b4-8533eae80589 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:21.565056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56911d31-08ab-426a-a9b4-8533eae80589 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:21.565503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56911d31-08ab-426a-a9b4-8533eae80589 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:21.565918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-56911d31-08ab-426a-a9b4-8533eae80589 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:21.694240 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-56911d31-08ab-426a-a9b4-8533eae80589 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:21.701695 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-56911d31-08ab-426a-a9b4-8533eae80589 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.149098 Aug 30 01:58:21.702247 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 184/370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:21 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:21.708396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a3c5a82f-2b4e-4d83-9459-ac5d5281669a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:21.708996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a3c5a82f-2b4e-4d83-9459-ac5d5281669a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:21.714871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a3c5a82f-2b4e-4d83-9459-ac5d5281669a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:21.715356 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a3c5a82f-2b4e-4d83-9459-ac5d5281669a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:21.715766 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a3c5a82f-2b4e-4d83-9459-ac5d5281669a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:21.716464 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a3c5a82f-2b4e-4d83-9459-ac5d5281669a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:21.716908 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a3c5a82f-2b4e-4d83-9459-ac5d5281669a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:21.717322 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a3c5a82f-2b4e-4d83-9459-ac5d5281669a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:21.840185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a3c5a82f-2b4e-4d83-9459-ac5d5281669a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:21.847649 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a3c5a82f-2b4e-4d83-9459-ac5d5281669a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.143015 Aug 30 01:58:21.848196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 187/371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:21 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:22.401452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7fd7b413-9b94-4902-9217-8c22b50eb9ca tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:22.402053 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7fd7b413-9b94-4902-9217-8c22b50eb9ca tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:22.408493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fd7b413-9b94-4902-9217-8c22b50eb9ca tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:22.408967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fd7b413-9b94-4902-9217-8c22b50eb9ca tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:22.409392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fd7b413-9b94-4902-9217-8c22b50eb9ca tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:22.410065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fd7b413-9b94-4902-9217-8c22b50eb9ca tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:22.410513 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fd7b413-9b94-4902-9217-8c22b50eb9ca tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:22.410926 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7fd7b413-9b94-4902-9217-8c22b50eb9ca tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:22.540926 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7fd7b413-9b94-4902-9217-8c22b50eb9ca tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:22.548642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7fd7b413-9b94-4902-9217-8c22b50eb9ca tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.151047 Aug 30 01:58:22.549133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 185/372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:22 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:22.578967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-26dae74f-dd79-4df9-93cb-624a45b2d175 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:22.579662 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-26dae74f-dd79-4df9-93cb-624a45b2d175 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:22.585954 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dae74f-dd79-4df9-93cb-624a45b2d175 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:22.586435 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dae74f-dd79-4df9-93cb-624a45b2d175 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:22.586868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dae74f-dd79-4df9-93cb-624a45b2d175 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:22.587557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dae74f-dd79-4df9-93cb-624a45b2d175 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:22.588007 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dae74f-dd79-4df9-93cb-624a45b2d175 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:22.588458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-26dae74f-dd79-4df9-93cb-624a45b2d175 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:22.605224 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-299bd704-4025-491d-ad55-0b0b00e205f6 req-f93b8181-f112-4397-a8a6-c765d1db08c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ee86d8-d269-493f-a24a-32c664d277d9", "name": "network-vif-plugged", "status": "completed", "tag": "f1dd3161-ede7-45be-a32c-472d4a0a6a58"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:22.616640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-299bd704-4025-491d-ad55-0b0b00e205f6 req-f93b8181-f112-4397-a8a6-c765d1db08c0 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:22.617501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-299bd704-4025-491d-ad55-0b0b00e205f6 req-f93b8181-f112-4397-a8a6-c765d1db08c0 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:22.617892 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-299bd704-4025-491d-ad55-0b0b00e205f6 req-f93b8181-f112-4397-a8a6-c765d1db08c0 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:22.629900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-299bd704-4025-491d-ad55-0b0b00e205f6 req-f93b8181-f112-4397-a8a6-c765d1db08c0 service nova] Creating event network-vif-plugged:f1dd3161-ede7-45be-a32c-472d4a0a6a58 for instance b5ee86d8-d269-493f-a24a-32c664d277d9 on hv-cinder-81966 Aug 30 01:58:22.634638 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-299bd704-4025-491d-ad55-0b0b00e205f6 req-f93b8181-f112-4397-a8a6-c765d1db08c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033210 Aug 30 01:58:22.635226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 186/373] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:58:22.655390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-26dae74f-dd79-4df9-93cb-624a45b2d175 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:22.663588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-26dae74f-dd79-4df9-93cb-624a45b2d175 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1272 microversion: 2.1 time: 0.088382 Aug 30 01:58:22.664130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 188/374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:22 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:22.723235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-baf72428-e592-43e0-a04f-17227130bac7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:22.723935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-baf72428-e592-43e0-a04f-17227130bac7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:22.730597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-baf72428-e592-43e0-a04f-17227130bac7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:22.731074 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-baf72428-e592-43e0-a04f-17227130bac7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:22.731508 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-baf72428-e592-43e0-a04f-17227130bac7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:22.732184 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-baf72428-e592-43e0-a04f-17227130bac7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:22.732663 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-baf72428-e592-43e0-a04f-17227130bac7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:22.733085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-baf72428-e592-43e0-a04f-17227130bac7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:22.861857 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-baf72428-e592-43e0-a04f-17227130bac7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:22.868376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e11704ca-84ad-4cb9-8ed5-7408ddb68bf2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:22.868991 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e11704ca-84ad-4cb9-8ed5-7408ddb68bf2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:22.869565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-baf72428-e592-43e0-a04f-17227130bac7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.150425 Aug 30 01:58:22.870120 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 187/375] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:22 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:22.870968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:22.876641 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e11704ca-84ad-4cb9-8ed5-7408ddb68bf2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:22.877123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e11704ca-84ad-4cb9-8ed5-7408ddb68bf2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:22.877557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e11704ca-84ad-4cb9-8ed5-7408ddb68bf2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:22.878523 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e11704ca-84ad-4cb9-8ed5-7408ddb68bf2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:22.878978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e11704ca-84ad-4cb9-8ed5-7408ddb68bf2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:22.879404 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e11704ca-84ad-4cb9-8ed5-7408ddb68bf2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:23.010167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e11704ca-84ad-4cb9-8ed5-7408ddb68bf2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:23.017724 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e11704ca-84ad-4cb9-8ed5-7408ddb68bf2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.153187 Aug 30 01:58:23.018287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 189/376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:22 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:23.570129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e5569bf3-98ef-49a3-af9f-e81b1b82cb60 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:23.570667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e5569bf3-98ef-49a3-af9f-e81b1b82cb60 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:23.577011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5569bf3-98ef-49a3-af9f-e81b1b82cb60 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:23.577484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5569bf3-98ef-49a3-af9f-e81b1b82cb60 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:23.577909 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5569bf3-98ef-49a3-af9f-e81b1b82cb60 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:23.578580 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5569bf3-98ef-49a3-af9f-e81b1b82cb60 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:23.579036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5569bf3-98ef-49a3-af9f-e81b1b82cb60 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:23.579454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5569bf3-98ef-49a3-af9f-e81b1b82cb60 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:23.684665 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8b41a635-4c3e-4a97-b667-6fa4320a587d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:23.685349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8b41a635-4c3e-4a97-b667-6fa4320a587d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:23.691187 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b41a635-4c3e-4a97-b667-6fa4320a587d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:23.691658 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b41a635-4c3e-4a97-b667-6fa4320a587d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:23.692083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b41a635-4c3e-4a97-b667-6fa4320a587d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:23.692819 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b41a635-4c3e-4a97-b667-6fa4320a587d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:23.693831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b41a635-4c3e-4a97-b667-6fa4320a587d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:23.694250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b41a635-4c3e-4a97-b667-6fa4320a587d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:23.705506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e5569bf3-98ef-49a3-af9f-e81b1b82cb60 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:23.713102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e5569bf3-98ef-49a3-af9f-e81b1b82cb60 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.147486 Aug 30 01:58:23.713658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 188/377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:23 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:23.753255 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8b41a635-4c3e-4a97-b667-6fa4320a587d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:23.761390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8b41a635-4c3e-4a97-b667-6fa4320a587d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1272 microversion: 2.1 time: 0.080562 Aug 30 01:58:23.761935 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 190/378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:23 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1272 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:23.891069 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cf26a09e-5d8b-4752-9034-b998824b6561 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:23.891608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cf26a09e-5d8b-4752-9034-b998824b6561 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:23.897472 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf26a09e-5d8b-4752-9034-b998824b6561 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:23.897946 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf26a09e-5d8b-4752-9034-b998824b6561 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:23.898516 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf26a09e-5d8b-4752-9034-b998824b6561 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:23.899080 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf26a09e-5d8b-4752-9034-b998824b6561 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:23.899620 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf26a09e-5d8b-4752-9034-b998824b6561 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:23.900070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cf26a09e-5d8b-4752-9034-b998824b6561 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:24.024417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cf26a09e-5d8b-4752-9034-b998824b6561 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:24.032099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cf26a09e-5d8b-4752-9034-b998824b6561 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.145044 Aug 30 01:58:24.032690 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 189/379] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:23 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:24.038520 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-455944eb-cfba-405f-91ba-ca4e1eecae5d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:24.039123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-455944eb-cfba-405f-91ba-ca4e1eecae5d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:24.044996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-455944eb-cfba-405f-91ba-ca4e1eecae5d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:24.045464 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-455944eb-cfba-405f-91ba-ca4e1eecae5d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:24.045889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-455944eb-cfba-405f-91ba-ca4e1eecae5d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:24.046562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-455944eb-cfba-405f-91ba-ca4e1eecae5d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:24.047003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-455944eb-cfba-405f-91ba-ca4e1eecae5d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:24.047414 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-455944eb-cfba-405f-91ba-ca4e1eecae5d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:24.171737 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-455944eb-cfba-405f-91ba-ca4e1eecae5d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:24.179424 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-455944eb-cfba-405f-91ba-ca4e1eecae5d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.144606 Aug 30 01:58:24.180173 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 191/380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:24 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:24.733552 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6668a198-5e3a-4ad8-852e-9a20c43bc4d9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:24.734153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6668a198-5e3a-4ad8-852e-9a20c43bc4d9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:24.740592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6668a198-5e3a-4ad8-852e-9a20c43bc4d9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:24.741072 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6668a198-5e3a-4ad8-852e-9a20c43bc4d9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:24.741500 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6668a198-5e3a-4ad8-852e-9a20c43bc4d9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:24.742184 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6668a198-5e3a-4ad8-852e-9a20c43bc4d9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:24.742626 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6668a198-5e3a-4ad8-852e-9a20c43bc4d9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:24.743041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6668a198-5e3a-4ad8-852e-9a20c43bc4d9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:24.782299 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d64c2b73-5e14-41d5-8aa4-a1e4931376ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:24.783736 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d64c2b73-5e14-41d5-8aa4-a1e4931376ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:24.791193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64c2b73-5e14-41d5-8aa4-a1e4931376ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:24.791681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64c2b73-5e14-41d5-8aa4-a1e4931376ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:24.792110 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64c2b73-5e14-41d5-8aa4-a1e4931376ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:24.792850 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64c2b73-5e14-41d5-8aa4-a1e4931376ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:24.793452 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64c2b73-5e14-41d5-8aa4-a1e4931376ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:24.793883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64c2b73-5e14-41d5-8aa4-a1e4931376ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:24.939704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d64c2b73-5e14-41d5-8aa4-a1e4931376ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:24.947957 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d64c2b73-5e14-41d5-8aa4-a1e4931376ac tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.169907 Aug 30 01:58:24.961667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6668a198-5e3a-4ad8-852e-9a20c43bc4d9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:24.962227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 192/381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:24 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:24.966790 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6668a198-5e3a-4ad8-852e-9a20c43bc4d9 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.237073 Aug 30 01:58:24.967428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 190/382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:24 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:25.051897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-02895252-5646-4f3c-a9ff-5fd9fec829b7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:25.053083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-02895252-5646-4f3c-a9ff-5fd9fec829b7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:25.058883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02895252-5646-4f3c-a9ff-5fd9fec829b7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:25.059370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02895252-5646-4f3c-a9ff-5fd9fec829b7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:25.059809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02895252-5646-4f3c-a9ff-5fd9fec829b7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:25.060535 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02895252-5646-4f3c-a9ff-5fd9fec829b7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:25.060991 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02895252-5646-4f3c-a9ff-5fd9fec829b7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:25.061420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02895252-5646-4f3c-a9ff-5fd9fec829b7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:25.200409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-369132fc-a1f2-49b0-84fd-657fd649e73f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:25.201254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-369132fc-a1f2-49b0-84fd-657fd649e73f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:25.205850 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-02895252-5646-4f3c-a9ff-5fd9fec829b7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:25.207981 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369132fc-a1f2-49b0-84fd-657fd649e73f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:25.208387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369132fc-a1f2-49b0-84fd-657fd649e73f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:25.209031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369132fc-a1f2-49b0-84fd-657fd649e73f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:25.209919 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369132fc-a1f2-49b0-84fd-657fd649e73f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:25.210579 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369132fc-a1f2-49b0-84fd-657fd649e73f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:25.211158 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-369132fc-a1f2-49b0-84fd-657fd649e73f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:25.219001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-02895252-5646-4f3c-a9ff-5fd9fec829b7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.170924 Aug 30 01:58:25.219894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 193/383] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:25 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:25.437767 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-369132fc-a1f2-49b0-84fd-657fd649e73f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:25.446076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-369132fc-a1f2-49b0-84fd-657fd649e73f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.249551 Aug 30 01:58:25.447224 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 191/384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:25 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:25.492326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-7fc9ae6e-2d84-4834-98f4-3d391f77b2bb req-6365f7e9-3f70-47c0-908c-eee376a69062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7abfda5-7376-447a-815f-7e3829d09d9f", "tag": "ae60c784-53a4-43ac-a2ee-86af1415378b"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:25.501596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-7fc9ae6e-2d84-4834-98f4-3d391f77b2bb req-6365f7e9-3f70-47c0-908c-eee376a69062 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:25.502070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-7fc9ae6e-2d84-4834-98f4-3d391f77b2bb req-6365f7e9-3f70-47c0-908c-eee376a69062 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:25.502497 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-7fc9ae6e-2d84-4834-98f4-3d391f77b2bb req-6365f7e9-3f70-47c0-908c-eee376a69062 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:25.513430 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-7fc9ae6e-2d84-4834-98f4-3d391f77b2bb req-6365f7e9-3f70-47c0-908c-eee376a69062 service nova] Creating event network-changed:ae60c784-53a4-43ac-a2ee-86af1415378b for instance b7abfda5-7376-447a-815f-7e3829d09d9f on hv-cinder-81966 Aug 30 01:58:25.518346 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-7fc9ae6e-2d84-4834-98f4-3d391f77b2bb req-6365f7e9-3f70-47c0-908c-eee376a69062 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030244 Aug 30 01:58:25.520165 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 194/385] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:58:25.969152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e5165164-89d4-4190-9ec9-b37db7ec3c1b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:25.969817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e5165164-89d4-4190-9ec9-b37db7ec3c1b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:25.972255 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:25.978094 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5165164-89d4-4190-9ec9-b37db7ec3c1b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:25.978571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5165164-89d4-4190-9ec9-b37db7ec3c1b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:25.979004 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5165164-89d4-4190-9ec9-b37db7ec3c1b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:25.979684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5165164-89d4-4190-9ec9-b37db7ec3c1b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:25.980134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5165164-89d4-4190-9ec9-b37db7ec3c1b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:25.980588 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e5165164-89d4-4190-9ec9-b37db7ec3c1b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:25.987220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8cfcb993-a42a-4003-907e-c75c2f4575f3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:25.987989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8cfcb993-a42a-4003-907e-c75c2f4575f3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:25.994037 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8cfcb993-a42a-4003-907e-c75c2f4575f3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:25.994512 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8cfcb993-a42a-4003-907e-c75c2f4575f3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:25.994940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8cfcb993-a42a-4003-907e-c75c2f4575f3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:25.995624 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8cfcb993-a42a-4003-907e-c75c2f4575f3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:25.996068 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8cfcb993-a42a-4003-907e-c75c2f4575f3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:25.996505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8cfcb993-a42a-4003-907e-c75c2f4575f3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:26.114262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e5165164-89d4-4190-9ec9-b37db7ec3c1b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:26.122679 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e5165164-89d4-4190-9ec9-b37db7ec3c1b tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.157269 Aug 30 01:58:26.123265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 192/386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:25 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:26.242152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e40053e1-0265-4d78-ad8e-2e463b2184bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:26.242775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e40053e1-0265-4d78-ad8e-2e463b2184bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:26.249024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e40053e1-0265-4d78-ad8e-2e463b2184bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:26.249513 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e40053e1-0265-4d78-ad8e-2e463b2184bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:26.249947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e40053e1-0265-4d78-ad8e-2e463b2184bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:26.250698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e40053e1-0265-4d78-ad8e-2e463b2184bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:26.251332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e40053e1-0265-4d78-ad8e-2e463b2184bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:26.251761 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e40053e1-0265-4d78-ad8e-2e463b2184bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:26.383188 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e40053e1-0265-4d78-ad8e-2e463b2184bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:26.390733 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e40053e1-0265-4d78-ad8e-2e463b2184bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.152934 Aug 30 01:58:26.391284 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 193/387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:26 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:26.427728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8cfcb993-a42a-4003-907e-c75c2f4575f3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:26.435303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8cfcb993-a42a-4003-907e-c75c2f4575f3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1260 microversion: 2.1 time: 0.452266 Aug 30 01:58:26.435935 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 195/388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:25 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1260 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:26.472935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c6965129-3e23-4e68-9e60-3b38414e8c91 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:26.473565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c6965129-3e23-4e68-9e60-3b38414e8c91 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:26.479403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6965129-3e23-4e68-9e60-3b38414e8c91 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:26.479883 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6965129-3e23-4e68-9e60-3b38414e8c91 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:26.480347 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6965129-3e23-4e68-9e60-3b38414e8c91 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:26.481031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6965129-3e23-4e68-9e60-3b38414e8c91 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:26.481484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6965129-3e23-4e68-9e60-3b38414e8c91 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:26.481904 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6965129-3e23-4e68-9e60-3b38414e8c91 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:26.615781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c6965129-3e23-4e68-9e60-3b38414e8c91 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:26.624306 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c6965129-3e23-4e68-9e60-3b38414e8c91 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.155196 Aug 30 01:58:26.636426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 194/389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:26 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:26.732367 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-351a8fdf-2fc0-432e-8a19-32cd7828fa46 req-9cd7ab05-fb15-4770-8e75-3314582c8e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33e0127-93b8-4cdb-913a-5863f403890e", "name": "network-vif-plugged", "status": "completed", "tag": "d2f0275f-d1ef-439d-83db-d9568b347aca"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:26.742928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-351a8fdf-2fc0-432e-8a19-32cd7828fa46 req-9cd7ab05-fb15-4770-8e75-3314582c8e48 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:26.743453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-351a8fdf-2fc0-432e-8a19-32cd7828fa46 req-9cd7ab05-fb15-4770-8e75-3314582c8e48 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:26.743879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-351a8fdf-2fc0-432e-8a19-32cd7828fa46 req-9cd7ab05-fb15-4770-8e75-3314582c8e48 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:26.757955 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-351a8fdf-2fc0-432e-8a19-32cd7828fa46 req-9cd7ab05-fb15-4770-8e75-3314582c8e48 service nova] Creating event network-vif-plugged:d2f0275f-d1ef-439d-83db-d9568b347aca for instance e33e0127-93b8-4cdb-913a-5863f403890e on hv-cinder-81966 Aug 30 01:58:26.762850 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-351a8fdf-2fc0-432e-8a19-32cd7828fa46 req-9cd7ab05-fb15-4770-8e75-3314582c8e48 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034227 Aug 30 01:58:26.763592 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 196/390] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:58:27.142966 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-388c17ee-f881-4436-bdcb-547844317199 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:27.143588 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-388c17ee-f881-4436-bdcb-547844317199 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:27.150450 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-388c17ee-f881-4436-bdcb-547844317199 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:27.151090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-388c17ee-f881-4436-bdcb-547844317199 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:27.151693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-388c17ee-f881-4436-bdcb-547844317199 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:27.152572 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-388c17ee-f881-4436-bdcb-547844317199 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:27.153083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-388c17ee-f881-4436-bdcb-547844317199 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:27.153544 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-388c17ee-f881-4436-bdcb-547844317199 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:27.327777 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-388c17ee-f881-4436-bdcb-547844317199 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:27.335930 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-388c17ee-f881-4436-bdcb-547844317199 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.196849 Aug 30 01:58:27.336527 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 195/391] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:27 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:27.413448 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-36051e9f-cd3d-4b71-a200-3445b4cbe960 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:27.414160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-36051e9f-cd3d-4b71-a200-3445b4cbe960 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:27.420199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-36051e9f-cd3d-4b71-a200-3445b4cbe960 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:27.420704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-36051e9f-cd3d-4b71-a200-3445b4cbe960 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:27.421131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-36051e9f-cd3d-4b71-a200-3445b4cbe960 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:27.422127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-36051e9f-cd3d-4b71-a200-3445b4cbe960 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:27.422579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-36051e9f-cd3d-4b71-a200-3445b4cbe960 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:27.422996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-36051e9f-cd3d-4b71-a200-3445b4cbe960 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:27.456128 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a70b52ff-763f-439e-afcd-8e494b5a3f6a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:27.456766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a70b52ff-763f-439e-afcd-8e494b5a3f6a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:27.463139 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a70b52ff-763f-439e-afcd-8e494b5a3f6a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:27.463618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a70b52ff-763f-439e-afcd-8e494b5a3f6a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:27.464057 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a70b52ff-763f-439e-afcd-8e494b5a3f6a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:27.464787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a70b52ff-763f-439e-afcd-8e494b5a3f6a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:27.465237 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a70b52ff-763f-439e-afcd-8e494b5a3f6a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:27.465656 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a70b52ff-763f-439e-afcd-8e494b5a3f6a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:27.550332 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-36051e9f-cd3d-4b71-a200-3445b4cbe960 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:27.558234 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-36051e9f-cd3d-4b71-a200-3445b4cbe960 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.149638 Aug 30 01:58:27.558796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 197/392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:27 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:27.594148 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a70b52ff-763f-439e-afcd-8e494b5a3f6a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:27.602430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a70b52ff-763f-439e-afcd-8e494b5a3f6a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1445 microversion: 2.1 time: 0.150220 Aug 30 01:58:27.602984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 196/393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:27 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:27.622256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0732ee44-8b72-4dc2-8737-88bd096ba7ae tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:27.622852 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0732ee44-8b72-4dc2-8737-88bd096ba7ae tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:27.628867 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0732ee44-8b72-4dc2-8737-88bd096ba7ae tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:27.629339 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0732ee44-8b72-4dc2-8737-88bd096ba7ae tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:27.629762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0732ee44-8b72-4dc2-8737-88bd096ba7ae tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:27.630437 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0732ee44-8b72-4dc2-8737-88bd096ba7ae tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:27.630883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0732ee44-8b72-4dc2-8737-88bd096ba7ae tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:27.631298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0732ee44-8b72-4dc2-8737-88bd096ba7ae tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:27.647066 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d93daa18-73ae-43ea-92e0-03dd7fdde9ef tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:27.647670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d93daa18-73ae-43ea-92e0-03dd7fdde9ef tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:27.653534 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d93daa18-73ae-43ea-92e0-03dd7fdde9ef tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:27.654016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d93daa18-73ae-43ea-92e0-03dd7fdde9ef tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:27.654446 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d93daa18-73ae-43ea-92e0-03dd7fdde9ef tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:27.655127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d93daa18-73ae-43ea-92e0-03dd7fdde9ef tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:27.655577 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d93daa18-73ae-43ea-92e0-03dd7fdde9ef tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:27.655998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d93daa18-73ae-43ea-92e0-03dd7fdde9ef tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:27.763343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0732ee44-8b72-4dc2-8737-88bd096ba7ae tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:27.771789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0732ee44-8b72-4dc2-8737-88bd096ba7ae tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1445 microversion: 2.1 time: 0.152616 Aug 30 01:58:27.772383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 198/394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:27 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:27.788424 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d93daa18-73ae-43ea-92e0-03dd7fdde9ef tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:27.796873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d93daa18-73ae-43ea-92e0-03dd7fdde9ef tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.153975 Aug 30 01:58:27.797669 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 197/395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:27 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:28.357371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-16248f99-0a2a-46e4-bafc-03c785d1d233 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:28.358004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-16248f99-0a2a-46e4-bafc-03c785d1d233 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:28.360060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:28.360717 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=8 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:28.368697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16248f99-0a2a-46e4-bafc-03c785d1d233 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:28.369544 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16248f99-0a2a-46e4-bafc-03c785d1d233 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:28.370093 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16248f99-0a2a-46e4-bafc-03c785d1d233 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:28.370677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16248f99-0a2a-46e4-bafc-03c785d1d233 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:28.371119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16248f99-0a2a-46e4-bafc-03c785d1d233 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:28.371800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16248f99-0a2a-46e4-bafc-03c785d1d233 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:28.579518 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f48953de-afb4-4419-951c-f99e0a478e94 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:28.580407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f48953de-afb4-4419-951c-f99e0a478e94 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:28.582743 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=10 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:28.588805 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f48953de-afb4-4419-951c-f99e0a478e94 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:28.589298 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f48953de-afb4-4419-951c-f99e0a478e94 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:28.589930 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f48953de-afb4-4419-951c-f99e0a478e94 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:28.590799 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f48953de-afb4-4419-951c-f99e0a478e94 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:28.591415 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f48953de-afb4-4419-951c-f99e0a478e94 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:28.591850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f48953de-afb4-4419-951c-f99e0a478e94 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:28.634872 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-16248f99-0a2a-46e4-bafc-03c785d1d233 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:28.644793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-16248f99-0a2a-46e4-bafc-03c785d1d233 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.291181 Aug 30 01:58:28.652953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 199/396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:28 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:28.731322 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f48953de-afb4-4419-951c-f99e0a478e94 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:28.739274 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f48953de-afb4-4419-951c-f99e0a478e94 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.163735 Aug 30 01:58:28.739966 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 198/397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:28 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:28.816932 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cbed8c0c-ffe9-4bd2-bcce-062e1f032fe3 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:28.817531 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cbed8c0c-ffe9-4bd2-bcce-062e1f032fe3 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:28.823997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbed8c0c-ffe9-4bd2-bcce-062e1f032fe3 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:28.824500 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbed8c0c-ffe9-4bd2-bcce-062e1f032fe3 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:28.824926 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbed8c0c-ffe9-4bd2-bcce-062e1f032fe3 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:28.825605 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbed8c0c-ffe9-4bd2-bcce-062e1f032fe3 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:28.826048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbed8c0c-ffe9-4bd2-bcce-062e1f032fe3 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:28.826462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbed8c0c-ffe9-4bd2-bcce-062e1f032fe3 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:29.020343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cbed8c0c-ffe9-4bd2-bcce-062e1f032fe3 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:29.028021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cbed8c0c-ffe9-4bd2-bcce-062e1f032fe3 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.214941 Aug 30 01:58:29.028690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 200/398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:28 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:29.631971 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-264cf21f-1718-42a2-802f-449dab2d8430 req-3cc088f3-7d6c-4ad5-9444-98f612f3242a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ee86d8-d269-493f-a24a-32c664d277d9", "tag": "f1dd3161-ede7-45be-a32c-472d4a0a6a58"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:29.641888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-264cf21f-1718-42a2-802f-449dab2d8430 req-3cc088f3-7d6c-4ad5-9444-98f612f3242a service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:29.642372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-264cf21f-1718-42a2-802f-449dab2d8430 req-3cc088f3-7d6c-4ad5-9444-98f612f3242a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:29.642818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-264cf21f-1718-42a2-802f-449dab2d8430 req-3cc088f3-7d6c-4ad5-9444-98f612f3242a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:29.646967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:29.654748 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-264cf21f-1718-42a2-802f-449dab2d8430 req-3cc088f3-7d6c-4ad5-9444-98f612f3242a service nova] Creating event network-changed:f1dd3161-ede7-45be-a32c-472d4a0a6a58 for instance b5ee86d8-d269-493f-a24a-32c664d277d9 on hv-cinder-81966 Aug 30 01:58:29.659695 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-264cf21f-1718-42a2-802f-449dab2d8430 req-3cc088f3-7d6c-4ad5-9444-98f612f3242a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031524 Aug 30 01:58:29.660551 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 199/399] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:58:29.665636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5e513d12-a1dd-4df7-a5f0-1f030cda4ead tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:29.666246 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5e513d12-a1dd-4df7-a5f0-1f030cda4ead tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:29.672171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e513d12-a1dd-4df7-a5f0-1f030cda4ead tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:29.672687 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e513d12-a1dd-4df7-a5f0-1f030cda4ead tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:29.673121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e513d12-a1dd-4df7-a5f0-1f030cda4ead tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:29.673809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e513d12-a1dd-4df7-a5f0-1f030cda4ead tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:29.674262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e513d12-a1dd-4df7-a5f0-1f030cda4ead tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:29.674685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e513d12-a1dd-4df7-a5f0-1f030cda4ead tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:29.678843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:29.760629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2847208e-7a7e-4d26-ade4-5046dbfd543e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:29.761423 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2847208e-7a7e-4d26-ade4-5046dbfd543e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:29.767774 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2847208e-7a7e-4d26-ade4-5046dbfd543e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:29.768395 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2847208e-7a7e-4d26-ade4-5046dbfd543e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:29.769072 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2847208e-7a7e-4d26-ade4-5046dbfd543e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:29.769979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2847208e-7a7e-4d26-ade4-5046dbfd543e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:29.770637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2847208e-7a7e-4d26-ade4-5046dbfd543e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:29.771698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2847208e-7a7e-4d26-ade4-5046dbfd543e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:29.808982 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5e513d12-a1dd-4df7-a5f0-1f030cda4ead tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:29.816952 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5e513d12-a1dd-4df7-a5f0-1f030cda4ead tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.155652 Aug 30 01:58:29.817655 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 201/400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:29 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:29.902641 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2847208e-7a7e-4d26-ade4-5046dbfd543e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:29.910618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2847208e-7a7e-4d26-ade4-5046dbfd543e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.154183 Aug 30 01:58:29.911201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 200/401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:29 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:30.048625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b3a25441-ad8e-4385-a44c-70c614570fbc tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:30.049234 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b3a25441-ad8e-4385-a44c-70c614570fbc tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:30.055647 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b3a25441-ad8e-4385-a44c-70c614570fbc tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:30.056128 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b3a25441-ad8e-4385-a44c-70c614570fbc tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:30.056586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b3a25441-ad8e-4385-a44c-70c614570fbc tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:30.057270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b3a25441-ad8e-4385-a44c-70c614570fbc tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:30.057718 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b3a25441-ad8e-4385-a44c-70c614570fbc tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:30.058141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b3a25441-ad8e-4385-a44c-70c614570fbc tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:30.185652 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b3a25441-ad8e-4385-a44c-70c614570fbc tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:30.193262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b3a25441-ad8e-4385-a44c-70c614570fbc tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.148434 Aug 30 01:58:30.193824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 202/402] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:30 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:30.838598 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0e9124e3-fb2d-4b2b-ba41-03e8d421f170 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:30.839322 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0e9124e3-fb2d-4b2b-ba41-03e8d421f170 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:30.845789 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e9124e3-fb2d-4b2b-ba41-03e8d421f170 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:30.846289 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e9124e3-fb2d-4b2b-ba41-03e8d421f170 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:30.846712 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e9124e3-fb2d-4b2b-ba41-03e8d421f170 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:30.847391 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e9124e3-fb2d-4b2b-ba41-03e8d421f170 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:30.847835 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e9124e3-fb2d-4b2b-ba41-03e8d421f170 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:30.848272 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e9124e3-fb2d-4b2b-ba41-03e8d421f170 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:30.932370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5c520b0d-08a8-48ac-a689-9071a4dd8a5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:30.932979 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5c520b0d-08a8-48ac-a689-9071a4dd8a5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:30.939071 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c520b0d-08a8-48ac-a689-9071a4dd8a5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:30.939551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c520b0d-08a8-48ac-a689-9071a4dd8a5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:30.939985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c520b0d-08a8-48ac-a689-9071a4dd8a5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:30.940714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c520b0d-08a8-48ac-a689-9071a4dd8a5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:30.941169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c520b0d-08a8-48ac-a689-9071a4dd8a5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:30.941595 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c520b0d-08a8-48ac-a689-9071a4dd8a5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:30.979714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0e9124e3-fb2d-4b2b-ba41-03e8d421f170 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:30.987477 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0e9124e3-fb2d-4b2b-ba41-03e8d421f170 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.152685 Aug 30 01:58:30.988041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 201/403] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:30 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:31.068938 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5c520b0d-08a8-48ac-a689-9071a4dd8a5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:31.076525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5c520b0d-08a8-48ac-a689-9071a4dd8a5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.148313 Aug 30 01:58:31.077032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 203/404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:30 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:31.213719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-10e42114-6a76-4571-a2c8-56cc006fbc5e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:31.214340 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-10e42114-6a76-4571-a2c8-56cc006fbc5e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:31.220519 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10e42114-6a76-4571-a2c8-56cc006fbc5e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:31.221007 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10e42114-6a76-4571-a2c8-56cc006fbc5e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:31.221440 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10e42114-6a76-4571-a2c8-56cc006fbc5e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:31.222133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10e42114-6a76-4571-a2c8-56cc006fbc5e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:31.222583 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10e42114-6a76-4571-a2c8-56cc006fbc5e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:31.223002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10e42114-6a76-4571-a2c8-56cc006fbc5e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:31.347595 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-10e42114-6a76-4571-a2c8-56cc006fbc5e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:31.355251 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-10e42114-6a76-4571-a2c8-56cc006fbc5e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1319 microversion: 2.1 time: 0.145489 Aug 30 01:58:31.355804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 202/405] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:31 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:32.008391 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0d4165df-05b2-450d-9bf2-4bf39d805b2c tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:32.009355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0d4165df-05b2-450d-9bf2-4bf39d805b2c tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:32.015389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0d4165df-05b2-450d-9bf2-4bf39d805b2c tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:32.015867 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0d4165df-05b2-450d-9bf2-4bf39d805b2c tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:32.016312 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0d4165df-05b2-450d-9bf2-4bf39d805b2c tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:32.017002 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0d4165df-05b2-450d-9bf2-4bf39d805b2c tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:32.017445 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0d4165df-05b2-450d-9bf2-4bf39d805b2c tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:32.017862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0d4165df-05b2-450d-9bf2-4bf39d805b2c tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:32.098596 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2333e9e2-6993-4ece-bcf4-8d3c637b16fb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:32.099240 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2333e9e2-6993-4ece-bcf4-8d3c637b16fb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:32.106571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2333e9e2-6993-4ece-bcf4-8d3c637b16fb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:32.107055 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2333e9e2-6993-4ece-bcf4-8d3c637b16fb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:32.107483 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2333e9e2-6993-4ece-bcf4-8d3c637b16fb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:32.108173 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2333e9e2-6993-4ece-bcf4-8d3c637b16fb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:32.108647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2333e9e2-6993-4ece-bcf4-8d3c637b16fb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:32.109283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2333e9e2-6993-4ece-bcf4-8d3c637b16fb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:32.150775 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0d4165df-05b2-450d-9bf2-4bf39d805b2c tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:32.158728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0d4165df-05b2-450d-9bf2-4bf39d805b2c tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.154099 Aug 30 01:58:32.159680 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 204/406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:32 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:32.244642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2333e9e2-6993-4ece-bcf4-8d3c637b16fb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:32.252196 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2333e9e2-6993-4ece-bcf4-8d3c637b16fb tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.158694 Aug 30 01:58:32.252776 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 203/407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:32 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:32.378462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5fc9d908-38e8-4978-8220-2dc1ec720fe1 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:32.379087 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5fc9d908-38e8-4978-8220-2dc1ec720fe1 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:32.385407 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5fc9d908-38e8-4978-8220-2dc1ec720fe1 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:32.385874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5fc9d908-38e8-4978-8220-2dc1ec720fe1 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:32.386305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5fc9d908-38e8-4978-8220-2dc1ec720fe1 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:32.386974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5fc9d908-38e8-4978-8220-2dc1ec720fe1 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:32.387416 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5fc9d908-38e8-4978-8220-2dc1ec720fe1 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:32.387828 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5fc9d908-38e8-4978-8220-2dc1ec720fe1 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:32.513707 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5fc9d908-38e8-4978-8220-2dc1ec720fe1 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:32.521666 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5fc9d908-38e8-4978-8220-2dc1ec720fe1 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1508 microversion: 2.1 time: 0.147048 Aug 30 01:58:32.522220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 205/408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:32 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:33.181594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8b960260-4002-4725-88f4-752460c8483d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:33.181990 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8b960260-4002-4725-88f4-752460c8483d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:33.189030 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8b960260-4002-4725-88f4-752460c8483d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:33.189603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8b960260-4002-4725-88f4-752460c8483d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:33.190043 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8b960260-4002-4725-88f4-752460c8483d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:33.190758 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8b960260-4002-4725-88f4-752460c8483d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:33.191209 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8b960260-4002-4725-88f4-752460c8483d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:33.191633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8b960260-4002-4725-88f4-752460c8483d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:33.273607 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8a089159-bd33-47ce-8ce7-151ebb580525 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:33.274249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8a089159-bd33-47ce-8ce7-151ebb580525 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:33.280133 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a089159-bd33-47ce-8ce7-151ebb580525 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:33.280651 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a089159-bd33-47ce-8ce7-151ebb580525 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:33.281087 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a089159-bd33-47ce-8ce7-151ebb580525 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:33.281786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a089159-bd33-47ce-8ce7-151ebb580525 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:33.282237 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a089159-bd33-47ce-8ce7-151ebb580525 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:33.282661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a089159-bd33-47ce-8ce7-151ebb580525 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:33.424368 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8b960260-4002-4725-88f4-752460c8483d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:33.435778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8b960260-4002-4725-88f4-752460c8483d tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.258020 Aug 30 01:58:33.438711 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 204/409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:33 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:33.468015 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8a089159-bd33-47ce-8ce7-151ebb580525 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:33.475863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8a089159-bd33-47ce-8ce7-151ebb580525 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.206627 Aug 30 01:58:33.476452 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 206/410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:33 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:34.458784 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0430cd9b-e4a6-46ca-9ed5-53cac8673ce5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:34.459387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0430cd9b-e4a6-46ca-9ed5-53cac8673ce5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:34.465758 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0430cd9b-e4a6-46ca-9ed5-53cac8673ce5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:34.466230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0430cd9b-e4a6-46ca-9ed5-53cac8673ce5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:34.466656 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0430cd9b-e4a6-46ca-9ed5-53cac8673ce5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:34.467335 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0430cd9b-e4a6-46ca-9ed5-53cac8673ce5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:34.467779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0430cd9b-e4a6-46ca-9ed5-53cac8673ce5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:34.468192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0430cd9b-e4a6-46ca-9ed5-53cac8673ce5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:34.496254 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8c6f5db4-8fa7-4fc4-bf5b-4e35a3d1db84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:34.496866 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8c6f5db4-8fa7-4fc4-bf5b-4e35a3d1db84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:34.503571 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c6f5db4-8fa7-4fc4-bf5b-4e35a3d1db84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:34.504067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c6f5db4-8fa7-4fc4-bf5b-4e35a3d1db84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:34.504518 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c6f5db4-8fa7-4fc4-bf5b-4e35a3d1db84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:34.505333 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c6f5db4-8fa7-4fc4-bf5b-4e35a3d1db84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:34.505777 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c6f5db4-8fa7-4fc4-bf5b-4e35a3d1db84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:34.506190 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c6f5db4-8fa7-4fc4-bf5b-4e35a3d1db84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:34.597425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0430cd9b-e4a6-46ca-9ed5-53cac8673ce5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:34.605674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0430cd9b-e4a6-46ca-9ed5-53cac8673ce5 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.150732 Aug 30 01:58:34.606226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 205/411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:34 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:34.635133 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8c6f5db4-8fa7-4fc4-bf5b-4e35a3d1db84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:34.642731 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8c6f5db4-8fa7-4fc4-bf5b-4e35a3d1db84 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.150366 Aug 30 01:58:34.643286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 207/412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:34 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:35.135022 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-4ba1b2ff-61a6-4f96-bc21-08cda27785c7 req-b45cdcfb-b0cb-4b83-88a1-cb31d0283bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7abfda5-7376-447a-815f-7e3829d09d9f", "name": "network-vif-plugged", "status": "completed", "tag": "ae60c784-53a4-43ac-a2ee-86af1415378b"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:35.144506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-4ba1b2ff-61a6-4f96-bc21-08cda27785c7 req-b45cdcfb-b0cb-4b83-88a1-cb31d0283bc2 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:35.144983 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-4ba1b2ff-61a6-4f96-bc21-08cda27785c7 req-b45cdcfb-b0cb-4b83-88a1-cb31d0283bc2 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:35.145434 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-4ba1b2ff-61a6-4f96-bc21-08cda27785c7 req-b45cdcfb-b0cb-4b83-88a1-cb31d0283bc2 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:35.156213 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-4ba1b2ff-61a6-4f96-bc21-08cda27785c7 req-b45cdcfb-b0cb-4b83-88a1-cb31d0283bc2 service nova] Creating event network-vif-plugged:ae60c784-53a4-43ac-a2ee-86af1415378b for instance b7abfda5-7376-447a-815f-7e3829d09d9f on hv-cinder-81966 Aug 30 01:58:35.160880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-4ba1b2ff-61a6-4f96-bc21-08cda27785c7 req-b45cdcfb-b0cb-4b83-88a1-cb31d0283bc2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030238 Aug 30 01:58:35.161448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 206/413] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:58:35.626885 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2df97caf-a836-428f-a324-e49427eb5657 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:35.628108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2df97caf-a836-428f-a324-e49427eb5657 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:35.635536 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2df97caf-a836-428f-a324-e49427eb5657 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:35.636009 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2df97caf-a836-428f-a324-e49427eb5657 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:35.636457 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2df97caf-a836-428f-a324-e49427eb5657 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:35.637129 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2df97caf-a836-428f-a324-e49427eb5657 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:35.637572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2df97caf-a836-428f-a324-e49427eb5657 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:35.637985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2df97caf-a836-428f-a324-e49427eb5657 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:35.664896 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3ce343c5-4877-4726-a259-91cc65765912 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:35.665585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3ce343c5-4877-4726-a259-91cc65765912 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:35.671765 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ce343c5-4877-4726-a259-91cc65765912 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:35.672273 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ce343c5-4877-4726-a259-91cc65765912 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:35.672703 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ce343c5-4877-4726-a259-91cc65765912 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:35.673389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ce343c5-4877-4726-a259-91cc65765912 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:35.673841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ce343c5-4877-4726-a259-91cc65765912 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:35.674265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ce343c5-4877-4726-a259-91cc65765912 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:35.781082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2df97caf-a836-428f-a324-e49427eb5657 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:35.789295 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2df97caf-a836-428f-a324-e49427eb5657 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.166140 Aug 30 01:58:35.789874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 208/414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:35 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:35.817254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3ce343c5-4877-4726-a259-91cc65765912 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:35.825473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3ce343c5-4877-4726-a259-91cc65765912 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.165313 Aug 30 01:58:35.826032 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 207/415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:35 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:36.810013 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-937313c7-a4db-4171-87c1-076779fca0da tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:36.810509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-937313c7-a4db-4171-87c1-076779fca0da tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:36.816687 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-937313c7-a4db-4171-87c1-076779fca0da tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:36.817162 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-937313c7-a4db-4171-87c1-076779fca0da tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:36.817589 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-937313c7-a4db-4171-87c1-076779fca0da tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:36.818787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-937313c7-a4db-4171-87c1-076779fca0da tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:36.819231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-937313c7-a4db-4171-87c1-076779fca0da tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:36.819646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-937313c7-a4db-4171-87c1-076779fca0da tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:36.846781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ff8aa5b0-f844-446c-b2b1-08c33c372037 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:36.847520 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ff8aa5b0-f844-446c-b2b1-08c33c372037 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:36.855549 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8aa5b0-f844-446c-b2b1-08c33c372037 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:36.856077 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8aa5b0-f844-446c-b2b1-08c33c372037 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:36.856684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8aa5b0-f844-446c-b2b1-08c33c372037 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:36.857556 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8aa5b0-f844-446c-b2b1-08c33c372037 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:36.858052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8aa5b0-f844-446c-b2b1-08c33c372037 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:36.858474 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8aa5b0-f844-446c-b2b1-08c33c372037 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:36.954360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-937313c7-a4db-4171-87c1-076779fca0da tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:36.962719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-937313c7-a4db-4171-87c1-076779fca0da tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.156614 Aug 30 01:58:36.963278 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 209/416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:36 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:37.228037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ff8aa5b0-f844-446c-b2b1-08c33c372037 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:37.235867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ff8aa5b0-f844-446c-b2b1-08c33c372037 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.393223 Aug 30 01:58:37.236384 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 208/417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:36 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:37.982970 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ed974af5-4c01-44cb-8c43-9bfe93f5b05a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:37.983560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ed974af5-4c01-44cb-8c43-9bfe93f5b05a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:37.989563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed974af5-4c01-44cb-8c43-9bfe93f5b05a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:37.990033 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed974af5-4c01-44cb-8c43-9bfe93f5b05a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:37.990452 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed974af5-4c01-44cb-8c43-9bfe93f5b05a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:37.991121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed974af5-4c01-44cb-8c43-9bfe93f5b05a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:37.991563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed974af5-4c01-44cb-8c43-9bfe93f5b05a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:37.991978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed974af5-4c01-44cb-8c43-9bfe93f5b05a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:38.129647 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ed974af5-4c01-44cb-8c43-9bfe93f5b05a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:38.137396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ed974af5-4c01-44cb-8c43-9bfe93f5b05a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.158300 Aug 30 01:58:38.137984 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 210/418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:37 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:38.257402 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7c6ba25d-6e97-4afd-ad02-00eb0a9edd0f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:38.258034 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7c6ba25d-6e97-4afd-ad02-00eb0a9edd0f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:38.264390 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c6ba25d-6e97-4afd-ad02-00eb0a9edd0f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:38.264864 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c6ba25d-6e97-4afd-ad02-00eb0a9edd0f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:38.265289 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c6ba25d-6e97-4afd-ad02-00eb0a9edd0f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:38.265961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c6ba25d-6e97-4afd-ad02-00eb0a9edd0f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:38.266407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c6ba25d-6e97-4afd-ad02-00eb0a9edd0f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:38.266820 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c6ba25d-6e97-4afd-ad02-00eb0a9edd0f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:38.394735 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7c6ba25d-6e97-4afd-ad02-00eb0a9edd0f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:38.402813 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7c6ba25d-6e97-4afd-ad02-00eb0a9edd0f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.149939 Aug 30 01:58:38.403362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 209/419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:38 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:39.159229 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-563d1687-c451-4fef-b43f-82719e89f228 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:39.159871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-563d1687-c451-4fef-b43f-82719e89f228 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:39.166929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-563d1687-c451-4fef-b43f-82719e89f228 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:39.167411 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-563d1687-c451-4fef-b43f-82719e89f228 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:39.167840 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-563d1687-c451-4fef-b43f-82719e89f228 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:39.168560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-563d1687-c451-4fef-b43f-82719e89f228 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:39.169005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-563d1687-c451-4fef-b43f-82719e89f228 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:39.169449 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-563d1687-c451-4fef-b43f-82719e89f228 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:39.299905 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-563d1687-c451-4fef-b43f-82719e89f228 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:39.309108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-563d1687-c451-4fef-b43f-82719e89f228 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1314 microversion: 2.1 time: 0.154834 Aug 30 01:58:39.309855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 211/420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:39 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:39.423127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4d040c50-57d1-4a4c-9605-2c812a5167b6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:39.423771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4d040c50-57d1-4a4c-9605-2c812a5167b6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:39.430629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d040c50-57d1-4a4c-9605-2c812a5167b6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:39.431110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d040c50-57d1-4a4c-9605-2c812a5167b6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:39.431540 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d040c50-57d1-4a4c-9605-2c812a5167b6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:39.432272 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d040c50-57d1-4a4c-9605-2c812a5167b6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:39.432787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d040c50-57d1-4a4c-9605-2c812a5167b6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:39.433260 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d040c50-57d1-4a4c-9605-2c812a5167b6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:39.564081 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4d040c50-57d1-4a4c-9605-2c812a5167b6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:39.572586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4d040c50-57d1-4a4c-9605-2c812a5167b6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1522 microversion: 2.1 time: 0.153267 Aug 30 01:58:39.573161 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 210/421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:39 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:40.330529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-44069d59-3e2c-42cf-a293-1ef92ee90606 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:40.331135 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-44069d59-3e2c-42cf-a293-1ef92ee90606 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:40.337174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44069d59-3e2c-42cf-a293-1ef92ee90606 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:40.337752 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44069d59-3e2c-42cf-a293-1ef92ee90606 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:40.338282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44069d59-3e2c-42cf-a293-1ef92ee90606 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:40.338976 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44069d59-3e2c-42cf-a293-1ef92ee90606 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:40.339462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44069d59-3e2c-42cf-a293-1ef92ee90606 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:40.339886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44069d59-3e2c-42cf-a293-1ef92ee90606 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:40.476604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-44069d59-3e2c-42cf-a293-1ef92ee90606 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:40.484272 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-44069d59-3e2c-42cf-a293-1ef92ee90606 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1499 microversion: 2.1 time: 0.157509 Aug 30 01:58:40.484944 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 212/422] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:40 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1499 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:40.593594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fc070b94-d11b-4802-bda7-5efa13973489 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:40.594193 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fc070b94-d11b-4802-bda7-5efa13973489 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:40.600949 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc070b94-d11b-4802-bda7-5efa13973489 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:40.601451 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc070b94-d11b-4802-bda7-5efa13973489 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:40.601879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc070b94-d11b-4802-bda7-5efa13973489 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:40.602556 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc070b94-d11b-4802-bda7-5efa13973489 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:40.603072 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc070b94-d11b-4802-bda7-5efa13973489 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:40.603537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc070b94-d11b-4802-bda7-5efa13973489 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:40.733632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fc070b94-d11b-4802-bda7-5efa13973489 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:40.742656 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fc070b94-d11b-4802-bda7-5efa13973489 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1502 microversion: 2.1 time: 0.152751 Aug 30 01:58:40.745568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 211/423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:40 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:40.765281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5939d1d7-15da-4b5b-bb57-27babfac0f9c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:40.765883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5939d1d7-15da-4b5b-bb57-27babfac0f9c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:40.773554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5939d1d7-15da-4b5b-bb57-27babfac0f9c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:40.774030 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5939d1d7-15da-4b5b-bb57-27babfac0f9c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:40.774458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5939d1d7-15da-4b5b-bb57-27babfac0f9c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:40.775144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5939d1d7-15da-4b5b-bb57-27babfac0f9c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:40.775589 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5939d1d7-15da-4b5b-bb57-27babfac0f9c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:40.776022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5939d1d7-15da-4b5b-bb57-27babfac0f9c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:40.907060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5939d1d7-15da-4b5b-bb57-27babfac0f9c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:40.914795 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5939d1d7-15da-4b5b-bb57-27babfac0f9c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1515 microversion: 2.1 time: 0.153315 Aug 30 01:58:40.915356 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 213/424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:40 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:41.149404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1c0dfdc8-2058-4ae6-b332-89d61ea487d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:41.149882 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1c0dfdc8-2058-4ae6-b332-89d61ea487d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:41.155990 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c0dfdc8-2058-4ae6-b332-89d61ea487d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:41.156512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c0dfdc8-2058-4ae6-b332-89d61ea487d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:41.156947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c0dfdc8-2058-4ae6-b332-89d61ea487d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:41.157639 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c0dfdc8-2058-4ae6-b332-89d61ea487d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:41.158086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c0dfdc8-2058-4ae6-b332-89d61ea487d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:41.158505 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1c0dfdc8-2058-4ae6-b332-89d61ea487d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:41.186125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1c0dfdc8-2058-4ae6-b332-89d61ea487d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:58:41.272121 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1c0dfdc8-2058-4ae6-b332-89d61ea487d8 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 204 len: 0 microversion: 2.1 time: 0.125563 Aug 30 01:58:41.276216 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 212/425] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 01:58:41 2022] DELETE /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:58:41.283211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-45d46ded-8f98-4f86-bf0d-e5ea2ab044bc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:41.289084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-45d46ded-8f98-4f86-bf0d-e5ea2ab044bc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:41.296119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45d46ded-8f98-4f86-bf0d-e5ea2ab044bc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:41.296804 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45d46ded-8f98-4f86-bf0d-e5ea2ab044bc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:41.297225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45d46ded-8f98-4f86-bf0d-e5ea2ab044bc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:41.298722 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45d46ded-8f98-4f86-bf0d-e5ea2ab044bc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:41.298722 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45d46ded-8f98-4f86-bf0d-e5ea2ab044bc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:41.299097 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45d46ded-8f98-4f86-bf0d-e5ea2ab044bc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:41.427814 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-45d46ded-8f98-4f86-bf0d-e5ea2ab044bc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:41.435524 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-45d46ded-8f98-4f86-bf0d-e5ea2ab044bc tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1505 microversion: 2.1 time: 0.158048 Aug 30 01:58:41.436073 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 214/426] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:41 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:42.456282 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-eb2181cf-d3ca-4931-bc2e-e0281edd6faa tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:42.456987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-eb2181cf-d3ca-4931-bc2e-e0281edd6faa tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:42.463085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb2181cf-d3ca-4931-bc2e-e0281edd6faa tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:42.463567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb2181cf-d3ca-4931-bc2e-e0281edd6faa tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:42.464199 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb2181cf-d3ca-4931-bc2e-e0281edd6faa tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:42.464726 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb2181cf-d3ca-4931-bc2e-e0281edd6faa tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:42.465166 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb2181cf-d3ca-4931-bc2e-e0281edd6faa tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:42.465584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eb2181cf-d3ca-4931-bc2e-e0281edd6faa tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:42.593563 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-eb2181cf-d3ca-4931-bc2e-e0281edd6faa tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:42.602219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-eb2181cf-d3ca-4931-bc2e-e0281edd6faa tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1505 microversion: 2.1 time: 0.150031 Aug 30 01:58:42.602779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 213/427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:42 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:43.370384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ed1a2da1-2f06-4040-bb95-9e22db02c96e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:43.373001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ed1a2da1-2f06-4040-bb95-9e22db02c96e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:43.379442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed1a2da1-2f06-4040-bb95-9e22db02c96e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:43.379927 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed1a2da1-2f06-4040-bb95-9e22db02c96e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:43.380391 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed1a2da1-2f06-4040-bb95-9e22db02c96e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:43.381694 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed1a2da1-2f06-4040-bb95-9e22db02c96e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:43.382144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed1a2da1-2f06-4040-bb95-9e22db02c96e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:43.382596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed1a2da1-2f06-4040-bb95-9e22db02c96e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:43.405296 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-ed1a2da1-2f06-4040-bb95-9e22db02c96e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lazy-loading 'flavor' on Instance uuid 48eb7084-94aa-46f2-911d-ca2463bfb25c {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:58:43.466741 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:43.477780 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ed1a2da1-2f06-4040-bb95-9e22db02c96e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c/action" status: 200 len: 32 microversion: 2.1 time: 0.111377 Aug 30 01:58:43.478965 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 215/428] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 01:58:43 2022] POST /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c/action => generated 32 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:58:43.487242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-46a8e908-4d09-41da-ab9b-0f4c59c9681c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:43.488334 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-46a8e908-4d09-41da-ab9b-0f4c59c9681c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:43.494874 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46a8e908-4d09-41da-ab9b-0f4c59c9681c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:43.495363 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46a8e908-4d09-41da-ab9b-0f4c59c9681c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:43.495927 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46a8e908-4d09-41da-ab9b-0f4c59c9681c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:43.496603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46a8e908-4d09-41da-ab9b-0f4c59c9681c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:43.497055 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46a8e908-4d09-41da-ab9b-0f4c59c9681c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:43.497472 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46a8e908-4d09-41da-ab9b-0f4c59c9681c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:43.626556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6136ae05-76ef-46ee-a81e-14adbeb8f953 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:43.627444 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6136ae05-76ef-46ee-a81e-14adbeb8f953 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:43.637200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6136ae05-76ef-46ee-a81e-14adbeb8f953 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:43.637682 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6136ae05-76ef-46ee-a81e-14adbeb8f953 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:43.638108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6136ae05-76ef-46ee-a81e-14adbeb8f953 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:43.638834 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6136ae05-76ef-46ee-a81e-14adbeb8f953 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:43.639244 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6136ae05-76ef-46ee-a81e-14adbeb8f953 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:43.639940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6136ae05-76ef-46ee-a81e-14adbeb8f953 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:43.670581 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-46a8e908-4d09-41da-ab9b-0f4c59c9681c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:43.681223 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-46a8e908-4d09-41da-ab9b-0f4c59c9681c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.197562 Aug 30 01:58:43.682200 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 214/429] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:43 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:43.870459 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6136ae05-76ef-46ee-a81e-14adbeb8f953 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:43.879174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6136ae05-76ef-46ee-a81e-14adbeb8f953 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1505 microversion: 2.1 time: 0.259131 Aug 30 01:58:43.879936 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 216/430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:43 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:58:44.533003 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-5e971f0a-9f46-4685-9371-d0e473624a99 req-00bd5ae6-5d9a-4a5e-be84-4c882e5e9ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7abfda5-7376-447a-815f-7e3829d09d9f", "name": "network-vif-deleted", "tag": "ae60c784-53a4-43ac-a2ee-86af1415378b"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:44.543036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5e971f0a-9f46-4685-9371-d0e473624a99 req-00bd5ae6-5d9a-4a5e-be84-4c882e5e9ec1 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:44.543525 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5e971f0a-9f46-4685-9371-d0e473624a99 req-00bd5ae6-5d9a-4a5e-be84-4c882e5e9ec1 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:44.543955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5e971f0a-9f46-4685-9371-d0e473624a99 req-00bd5ae6-5d9a-4a5e-be84-4c882e5e9ec1 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:44.555567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-5e971f0a-9f46-4685-9371-d0e473624a99 req-00bd5ae6-5d9a-4a5e-be84-4c882e5e9ec1 service nova] Creating event network-vif-deleted:ae60c784-53a4-43ac-a2ee-86af1415378b for instance b7abfda5-7376-447a-815f-7e3829d09d9f on hv-cinder-81966 Aug 30 01:58:44.560808 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-5e971f0a-9f46-4685-9371-d0e473624a99 req-00bd5ae6-5d9a-4a5e-be84-4c882e5e9ec1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031307 Aug 30 01:58:44.561399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 215/431] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:58:44.702276 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6fa0af31-874c-443b-bb24-b10c30e2d3b1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:44.702825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6fa0af31-874c-443b-bb24-b10c30e2d3b1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:44.708705 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6fa0af31-874c-443b-bb24-b10c30e2d3b1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:44.709194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6fa0af31-874c-443b-bb24-b10c30e2d3b1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:44.709628 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6fa0af31-874c-443b-bb24-b10c30e2d3b1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:44.710312 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6fa0af31-874c-443b-bb24-b10c30e2d3b1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:44.710762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6fa0af31-874c-443b-bb24-b10c30e2d3b1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:44.711185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6fa0af31-874c-443b-bb24-b10c30e2d3b1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:44.841879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6fa0af31-874c-443b-bb24-b10c30e2d3b1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:44.849784 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6fa0af31-874c-443b-bb24-b10c30e2d3b1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.151338 Aug 30 01:58:44.850458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 217/432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:44 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:44.902153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:44.903542 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:44.909819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:44.910361 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:44.910793 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:44.911485 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:44.912464 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:44.912889 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:44.917030 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:44.945845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:44.946357 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:44.946785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:44.947388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lazy-loading 'fault' on Instance uuid b7abfda5-7376-447a-815f-7e3829d09d9f {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:58:44.988779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5c9d73b6bb4b32b2da9386273690bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f5229567c4023adcbe0069a9b4abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:44.998048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3dba75d6-893f-4b88-abf0-3cd2ebc1ade2 tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 200 len: 1304 microversion: 2.1 time: 0.100411 Aug 30 01:58:44.998693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 216/433] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:44 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:45.870379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4aa9195e-0c87-410f-851a-c13667b2b41c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:45.870980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4aa9195e-0c87-410f-851a-c13667b2b41c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:45.876951 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aa9195e-0c87-410f-851a-c13667b2b41c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:45.877544 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aa9195e-0c87-410f-851a-c13667b2b41c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:45.877985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aa9195e-0c87-410f-851a-c13667b2b41c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:45.878916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aa9195e-0c87-410f-851a-c13667b2b41c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:45.879364 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aa9195e-0c87-410f-851a-c13667b2b41c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:45.879779 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aa9195e-0c87-410f-851a-c13667b2b41c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:46.019165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:46.019885 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] [instance: b7abfda5-7376-447a-815f-7e3829d09d9f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:46.027269 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:46.027762 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:46.028201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:46.028936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:46.029394 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:46.029819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:46.044376 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] HTTP exception thrown: Instance b7abfda5-7376-447a-815f-7e3829d09d9f could not be found. Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Request method failure captured: Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f HTTP/1.1 Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW6Ssrs6klDso8ND_xUXZ5cf4wjKWbCztVzX9_EcVOIAsHifwH-wamOveh7KX-OlKWOSVPtwzF7MgCKS0UVV96D1ApsFYJjgAG5BoWPUCrRuTQuu8R79PLbH_FFytSESTidXf_mtDoyRtpa8uSRBG47QbBFA7IG1tZCV3DaoQQdZxmU Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 154f5229567c4023adcbe0069a9b4abb Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesActionsTest-1506369466 Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 01:58:46.046079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/154f5229567c4023adcbe0069a9b4abb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/154f5229567c4023adcbe0069a9b4abb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/154f5229567c4023adcbe0069a9b4abb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_154f5229567c4023adcbe0069a9b4abb"}]}] Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesActionsTest-1506369466 Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 154f5229567c4023adcbe0069a9b4abb Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesActionsTest-1506369466 Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesActionsTest-1506369466-project Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: aa5c9d73b6bb4b32b2da9386273690bb Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesActionsTest-1506369466-project Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance b7abfda5-7376-447a-815f-7e3829d09d9f could not be found. Aug 30 01:58:46.047614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': 'b7abfda5-7376-447a-815f-7e3829d09d9f'} Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7abfda5-7376-447a-815f-7e3829d09d9f could not be found. Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:58:46.048448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7abfda5-7376-447a-815f-7e3829d09d9f could not be found. Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7abfda5-7376-447a-815f-7e3829d09d9f could not be found. Aug 30 01:58:46.049617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 01:58:46.050674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] Returning 404 to user: Instance b7abfda5-7376-447a-815f-7e3829d09d9f could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:58:46.050674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-01203df6-3d4d-4c02-b537-8d6579f1604a tempest-VolumesActionsTest-1506369466 tempest-VolumesActionsTest-1506369466-project] 10.222.0.50 "GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f" status: 404 len: 111 microversion: 2.1 time: 0.032279 Aug 30 01:58:46.050674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 217/434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:46 2022] GET /compute/v2.1/servers/b7abfda5-7376-447a-815f-7e3829d09d9f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:58:46.228214 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4aa9195e-0c87-410f-851a-c13667b2b41c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:46.235738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4aa9195e-0c87-410f-851a-c13667b2b41c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.369171 Aug 30 01:58:46.236508 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 218/435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:45 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:47.257873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4ddd4792-7e1c-49de-90e9-4b4f2d49f318 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:47.258475 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4ddd4792-7e1c-49de-90e9-4b4f2d49f318 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:47.264972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ddd4792-7e1c-49de-90e9-4b4f2d49f318 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:47.265452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ddd4792-7e1c-49de-90e9-4b4f2d49f318 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:47.265879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ddd4792-7e1c-49de-90e9-4b4f2d49f318 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:47.266553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ddd4792-7e1c-49de-90e9-4b4f2d49f318 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:47.267002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ddd4792-7e1c-49de-90e9-4b4f2d49f318 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:47.267416 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ddd4792-7e1c-49de-90e9-4b4f2d49f318 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:47.395376 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4ddd4792-7e1c-49de-90e9-4b4f2d49f318 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:47.403573 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4ddd4792-7e1c-49de-90e9-4b4f2d49f318 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.150316 Aug 30 01:58:47.404118 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 218/436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:47 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:48.424612 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-52fc7f24-4fda-4606-8989-8e8c0b650696 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:48.425212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-52fc7f24-4fda-4606-8989-8e8c0b650696 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:48.431614 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52fc7f24-4fda-4606-8989-8e8c0b650696 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:48.432085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52fc7f24-4fda-4606-8989-8e8c0b650696 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:48.432546 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52fc7f24-4fda-4606-8989-8e8c0b650696 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:48.433221 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52fc7f24-4fda-4606-8989-8e8c0b650696 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:48.433664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52fc7f24-4fda-4606-8989-8e8c0b650696 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:48.434078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52fc7f24-4fda-4606-8989-8e8c0b650696 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:48.556832 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-52fc7f24-4fda-4606-8989-8e8c0b650696 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:48.564723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-52fc7f24-4fda-4606-8989-8e8c0b650696 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.143987 Aug 30 01:58:48.565281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 219/437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:48 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:49.586461 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-adb7e213-f20e-4f4f-8c4b-6edea50a65fa tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:49.586997 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-adb7e213-f20e-4f4f-8c4b-6edea50a65fa tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:49.593656 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adb7e213-f20e-4f4f-8c4b-6edea50a65fa tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:49.594136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adb7e213-f20e-4f4f-8c4b-6edea50a65fa tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:49.594565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adb7e213-f20e-4f4f-8c4b-6edea50a65fa tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:49.595247 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adb7e213-f20e-4f4f-8c4b-6edea50a65fa tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:49.595692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adb7e213-f20e-4f4f-8c4b-6edea50a65fa tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:49.596111 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-adb7e213-f20e-4f4f-8c4b-6edea50a65fa tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:49.723519 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-adb7e213-f20e-4f4f-8c4b-6edea50a65fa tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:49.731613 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-adb7e213-f20e-4f4f-8c4b-6edea50a65fa tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.149133 Aug 30 01:58:49.732162 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 219/438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:49 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:50.752771 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c7f4f111-269d-48e0-8081-391e6c2a0025 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:50.753384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c7f4f111-269d-48e0-8081-391e6c2a0025 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:50.760294 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7f4f111-269d-48e0-8081-391e6c2a0025 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:50.760772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7f4f111-269d-48e0-8081-391e6c2a0025 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:50.761196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7f4f111-269d-48e0-8081-391e6c2a0025 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:50.761872 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7f4f111-269d-48e0-8081-391e6c2a0025 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:50.762320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7f4f111-269d-48e0-8081-391e6c2a0025 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:50.762738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c7f4f111-269d-48e0-8081-391e6c2a0025 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:50.890732 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c7f4f111-269d-48e0-8081-391e6c2a0025 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:50.898460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c7f4f111-269d-48e0-8081-391e6c2a0025 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.149476 Aug 30 01:58:50.899008 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 220/439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:50 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:51.919836 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b90ec858-aa22-49dd-bb7b-f5c6a9534bd3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:51.920488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b90ec858-aa22-49dd-bb7b-f5c6a9534bd3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:51.922886 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:51.928001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b90ec858-aa22-49dd-bb7b-f5c6a9534bd3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:51.928519 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b90ec858-aa22-49dd-bb7b-f5c6a9534bd3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:51.928957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b90ec858-aa22-49dd-bb7b-f5c6a9534bd3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:51.929653 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b90ec858-aa22-49dd-bb7b-f5c6a9534bd3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:51.930109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b90ec858-aa22-49dd-bb7b-f5c6a9534bd3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:51.930534 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b90ec858-aa22-49dd-bb7b-f5c6a9534bd3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:52.063098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b90ec858-aa22-49dd-bb7b-f5c6a9534bd3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:52.071359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b90ec858-aa22-49dd-bb7b-f5c6a9534bd3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.155342 Aug 30 01:58:52.071918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 220/440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:51 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:52.895449 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-63af8f99-4cb1-4522-8e7b-3135e9ae46cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:52.896018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-63af8f99-4cb1-4522-8e7b-3135e9ae46cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:52.898120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=64 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:58:52.903453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63af8f99-4cb1-4522-8e7b-3135e9ae46cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:52.903938 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63af8f99-4cb1-4522-8e7b-3135e9ae46cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:52.904398 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63af8f99-4cb1-4522-8e7b-3135e9ae46cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:52.905079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63af8f99-4cb1-4522-8e7b-3135e9ae46cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:52.905525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63af8f99-4cb1-4522-8e7b-3135e9ae46cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:52.905945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63af8f99-4cb1-4522-8e7b-3135e9ae46cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:52.929367 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-63af8f99-4cb1-4522-8e7b-3135e9ae46cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/ips" status: 200 len: 151 microversion: 2.20 time: 0.037289 Aug 30 01:58:52.929476 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 221/441] 10.222.0.50 () {60 vars in 1289 bytes} [Tue Aug 30 01:58:52 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:58:53.092920 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5645b0b1-8407-4b39-87b9-475bbcfee211 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:53.093528 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5645b0b1-8407-4b39-87b9-475bbcfee211 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:53.099504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5645b0b1-8407-4b39-87b9-475bbcfee211 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:53.099980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5645b0b1-8407-4b39-87b9-475bbcfee211 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:53.100453 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5645b0b1-8407-4b39-87b9-475bbcfee211 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:53.101133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5645b0b1-8407-4b39-87b9-475bbcfee211 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:53.101579 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5645b0b1-8407-4b39-87b9-475bbcfee211 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:53.101995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5645b0b1-8407-4b39-87b9-475bbcfee211 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:53.267074 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5645b0b1-8407-4b39-87b9-475bbcfee211 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:53.275475 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5645b0b1-8407-4b39-87b9-475bbcfee211 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.186945 Aug 30 01:58:53.276048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 221/442] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:53 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:54.296690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f2f80bd5-02ae-48a7-b119-e4064b965927 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:54.297833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f2f80bd5-02ae-48a7-b119-e4064b965927 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:54.305149 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f2f80bd5-02ae-48a7-b119-e4064b965927 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:54.305634 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f2f80bd5-02ae-48a7-b119-e4064b965927 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:54.306070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f2f80bd5-02ae-48a7-b119-e4064b965927 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:54.306755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f2f80bd5-02ae-48a7-b119-e4064b965927 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:54.307210 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f2f80bd5-02ae-48a7-b119-e4064b965927 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:54.307633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f2f80bd5-02ae-48a7-b119-e4064b965927 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:54.431102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f2f80bd5-02ae-48a7-b119-e4064b965927 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:54.438663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f2f80bd5-02ae-48a7-b119-e4064b965927 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.145782 Aug 30 01:58:54.439222 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 222/443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:54 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:55.460432 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c16eaf4f-4c16-48fb-a0f6-6c37dd8c3750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:55.461091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c16eaf4f-4c16-48fb-a0f6-6c37dd8c3750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:55.467371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c16eaf4f-4c16-48fb-a0f6-6c37dd8c3750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:55.467840 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c16eaf4f-4c16-48fb-a0f6-6c37dd8c3750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:55.468293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c16eaf4f-4c16-48fb-a0f6-6c37dd8c3750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:55.468973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c16eaf4f-4c16-48fb-a0f6-6c37dd8c3750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:55.469419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c16eaf4f-4c16-48fb-a0f6-6c37dd8c3750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:55.469838 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c16eaf4f-4c16-48fb-a0f6-6c37dd8c3750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:55.596222 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c16eaf4f-4c16-48fb-a0f6-6c37dd8c3750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:55.603832 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c16eaf4f-4c16-48fb-a0f6-6c37dd8c3750 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.147931 Aug 30 01:58:55.604400 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 222/444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:55 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:56.624655 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-73c05f4c-d3c7-4b2f-aeeb-40f606549943 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:56.625177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-73c05f4c-d3c7-4b2f-aeeb-40f606549943 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:56.631322 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73c05f4c-d3c7-4b2f-aeeb-40f606549943 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:56.631790 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73c05f4c-d3c7-4b2f-aeeb-40f606549943 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:56.632216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73c05f4c-d3c7-4b2f-aeeb-40f606549943 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:56.632907 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73c05f4c-d3c7-4b2f-aeeb-40f606549943 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:56.633354 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73c05f4c-d3c7-4b2f-aeeb-40f606549943 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:56.633778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73c05f4c-d3c7-4b2f-aeeb-40f606549943 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:56.774592 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-73c05f4c-d3c7-4b2f-aeeb-40f606549943 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:56.782106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-73c05f4c-d3c7-4b2f-aeeb-40f606549943 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.161344 Aug 30 01:58:56.782660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 223/445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:56 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:57.804868 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-99fde71e-5a9d-4db0-9ec7-7e2b18741e5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:57.805553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-99fde71e-5a9d-4db0-9ec7-7e2b18741e5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:57.812162 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99fde71e-5a9d-4db0-9ec7-7e2b18741e5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:57.812678 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99fde71e-5a9d-4db0-9ec7-7e2b18741e5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:57.813113 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99fde71e-5a9d-4db0-9ec7-7e2b18741e5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:57.813810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99fde71e-5a9d-4db0-9ec7-7e2b18741e5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:57.814260 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99fde71e-5a9d-4db0-9ec7-7e2b18741e5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:57.814685 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99fde71e-5a9d-4db0-9ec7-7e2b18741e5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:57.961246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-99fde71e-5a9d-4db0-9ec7-7e2b18741e5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:57.969486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-99fde71e-5a9d-4db0-9ec7-7e2b18741e5a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.168585 Aug 30 01:58:57.970587 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 223/446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:57 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:58.063817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-38255ea4-d7a1-431f-bbc8-5a007448b2fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:58:58.065029 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-38255ea4-d7a1-431f-bbc8-5a007448b2fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:58.072004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38255ea4-d7a1-431f-bbc8-5a007448b2fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:58.072537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38255ea4-d7a1-431f-bbc8-5a007448b2fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:58.072974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38255ea4-d7a1-431f-bbc8-5a007448b2fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:58.073680 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38255ea4-d7a1-431f-bbc8-5a007448b2fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:58.074164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38255ea4-d7a1-431f-bbc8-5a007448b2fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:58.074763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38255ea4-d7a1-431f-bbc8-5a007448b2fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:58.100874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-38255ea4-d7a1-431f-bbc8-5a007448b2fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lazy-loading 'flavor' on Instance uuid 51036535-5cf5-4283-b501-b0809e3f57a6 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:58:58.313328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-38255ea4-d7a1-431f-bbc8-5a007448b2fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "POST /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/action" status: 202 len: 0 microversion: 2.20 time: 0.256299 Aug 30 01:58:58.314137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 224/447] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 01:58:58 2022] POST /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:58:58.324797 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:58.325491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:58.336354 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:58.336982 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:58.337606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:58.338493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:58.338984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:58.339695 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:58.496343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:58.505716 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:58.507527 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:58.508929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6470596f-b7e3-4aa7-a228-9b55ca760021 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.189662 Aug 30 01:58:58.509832 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 224/448] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:58:58 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:58:58.991873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1cc647a0-2476-4f56-bf50-9c6345c42eb2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:58.992735 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1cc647a0-2476-4f56-bf50-9c6345c42eb2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:58.999382 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cc647a0-2476-4f56-bf50-9c6345c42eb2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:58.999890 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cc647a0-2476-4f56-bf50-9c6345c42eb2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:59.000381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cc647a0-2476-4f56-bf50-9c6345c42eb2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:59.001266 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cc647a0-2476-4f56-bf50-9c6345c42eb2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:59.001509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cc647a0-2476-4f56-bf50-9c6345c42eb2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:59.001924 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cc647a0-2476-4f56-bf50-9c6345c42eb2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:59.164678 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1cc647a0-2476-4f56-bf50-9c6345c42eb2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:59.176975 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1cc647a0-2476-4f56-bf50-9c6345c42eb2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.189756 Aug 30 01:58:59.179285 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 225/449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:58:58 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:58:59.532819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:58:59.533644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:58:59.540515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:59.541086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:59.541585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:59.542521 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:58:59.543189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:58:59.543619 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:58:59.692504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:59.706277 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:59.707842 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:58:59.709699 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7c71f74a-2726-43ed-9e65-8812990e1ed6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.181099 Aug 30 01:58:59.710438 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 225/450] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:58:59 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:00.199783 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-761df9bc-cefe-42b7-ba93-fbe6c4bae32b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:00.200394 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-761df9bc-cefe-42b7-ba93-fbe6c4bae32b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:00.206438 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-761df9bc-cefe-42b7-ba93-fbe6c4bae32b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:00.206918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-761df9bc-cefe-42b7-ba93-fbe6c4bae32b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:00.207349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-761df9bc-cefe-42b7-ba93-fbe6c4bae32b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:00.208034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-761df9bc-cefe-42b7-ba93-fbe6c4bae32b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:00.209052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-761df9bc-cefe-42b7-ba93-fbe6c4bae32b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:00.209746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-761df9bc-cefe-42b7-ba93-fbe6c4bae32b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:00.345047 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-761df9bc-cefe-42b7-ba93-fbe6c4bae32b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:00.353244 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-761df9bc-cefe-42b7-ba93-fbe6c4bae32b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.157350 Aug 30 01:59:00.369875 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 226/451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:00 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:00.736225 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:00.737572 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:00.744938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:00.745709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:00.746339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:00.747258 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:00.747902 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:00.748543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:00.886197 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:00.895132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:00.897596 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:00.899132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9cda8bd3-a3e0-454e-beda-6eb410f198db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.166711 Aug 30 01:59:00.914601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 226/452] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:00 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:01.379840 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ca9a83c9-33f1-4412-a1ab-9dbf752c4237 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:01.381031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ca9a83c9-33f1-4412-a1ab-9dbf752c4237 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:01.390946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ca9a83c9-33f1-4412-a1ab-9dbf752c4237 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:01.391772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ca9a83c9-33f1-4412-a1ab-9dbf752c4237 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:01.392350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ca9a83c9-33f1-4412-a1ab-9dbf752c4237 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:01.393681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ca9a83c9-33f1-4412-a1ab-9dbf752c4237 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:01.394462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ca9a83c9-33f1-4412-a1ab-9dbf752c4237 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:01.395633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ca9a83c9-33f1-4412-a1ab-9dbf752c4237 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:01.558507 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ca9a83c9-33f1-4412-a1ab-9dbf752c4237 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:01.566486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ca9a83c9-33f1-4412-a1ab-9dbf752c4237 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.191234 Aug 30 01:59:01.567085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 227/453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:01 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:01.921278 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:01.921810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:01.928996 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:01.929468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:01.929948 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:01.930642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:01.931089 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:01.931505 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:02.064074 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:02.072806 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:02.074244 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:02.075393 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-51263469-4b50-41a0-99fe-559eb37a0293 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.158172 Aug 30 01:59:02.075945 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 227/454] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:01 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:02.587832 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c5f23c64-901e-4662-b864-aa702cc37d08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:02.588348 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-100aab1c-5651-4462-a40f-d5f7dba51c4e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8018ded9-9871-4a0e-a7e4-653bf673cb4e", "device": "/dev/sdb"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:02.588854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c5f23c64-901e-4662-b864-aa702cc37d08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:02.592759 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-100aab1c-5651-4462-a40f-d5f7dba51c4e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:02.594708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5f23c64-901e-4662-b864-aa702cc37d08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:02.595211 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5f23c64-901e-4662-b864-aa702cc37d08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:02.595652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5f23c64-901e-4662-b864-aa702cc37d08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:02.596587 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5f23c64-901e-4662-b864-aa702cc37d08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:02.596835 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5f23c64-901e-4662-b864-aa702cc37d08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:02.597260 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5f23c64-901e-4662-b864-aa702cc37d08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:02.601121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-100aab1c-5651-4462-a40f-d5f7dba51c4e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:02.601976 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-100aab1c-5651-4462-a40f-d5f7dba51c4e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:02.602632 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-100aab1c-5651-4462-a40f-d5f7dba51c4e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:02.603770 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-100aab1c-5651-4462-a40f-d5f7dba51c4e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:02.604328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-100aab1c-5651-4462-a40f-d5f7dba51c4e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:02.604824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-100aab1c-5651-4462-a40f-d5f7dba51c4e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:02.771644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c5f23c64-901e-4662-b864-aa702cc37d08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:02.798047 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c5f23c64-901e-4662-b864-aa702cc37d08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.213766 Aug 30 01:59:02.798848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 228/455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:02 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:03.099017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:03.100457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:03.107465 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:03.108459 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:03.108895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:03.109828 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:03.110599 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:03.111190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:03.291228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:03.305109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:03.306703 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:03.308160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-43ed3075-7a69-49dd-9ae5-35cc95cc65c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.213505 Aug 30 01:59:03.312284 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 229/456] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:03 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:03.405505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-100aab1c-5651-4462-a40f-d5f7dba51c4e tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "POST /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821361 Aug 30 01:59:03.406249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 228/457] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 01:59:02 2022] POST /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e/os-volume_attachments => generated 194 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:59:03.821748 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-53ddd6ab-8f01-408a-9b84-001ee786dc7d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:03.822368 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-53ddd6ab-8f01-408a-9b84-001ee786dc7d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:03.828706 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53ddd6ab-8f01-408a-9b84-001ee786dc7d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:03.829197 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53ddd6ab-8f01-408a-9b84-001ee786dc7d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:03.829634 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53ddd6ab-8f01-408a-9b84-001ee786dc7d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:03.830328 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53ddd6ab-8f01-408a-9b84-001ee786dc7d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:03.830780 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53ddd6ab-8f01-408a-9b84-001ee786dc7d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:03.831201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53ddd6ab-8f01-408a-9b84-001ee786dc7d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:03.976998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-53ddd6ab-8f01-408a-9b84-001ee786dc7d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:03.986103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-53ddd6ab-8f01-408a-9b84-001ee786dc7d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.169969 Aug 30 01:59:03.986649 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 230/458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:03 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:04.333896 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:04.335438 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:04.342359 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:04.343101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:04.343771 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:04.344725 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:04.345423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:04.345921 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:04.361661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:04.515373 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:04.533753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:04.549013 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:04.550478 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3915146e-5ee4-431b-b2c2-ec1e8b8a210a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.221925 Aug 30 01:59:04.551241 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 229/459] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:04 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:05.010914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d0b5f051-d3ce-4c74-a270-73f0a4eb48f6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:05.012660 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d0b5f051-d3ce-4c74-a270-73f0a4eb48f6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:05.021699 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0b5f051-d3ce-4c74-a270-73f0a4eb48f6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:05.022491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0b5f051-d3ce-4c74-a270-73f0a4eb48f6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:05.023216 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0b5f051-d3ce-4c74-a270-73f0a4eb48f6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:05.024440 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0b5f051-d3ce-4c74-a270-73f0a4eb48f6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:05.025174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0b5f051-d3ce-4c74-a270-73f0a4eb48f6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:05.025874 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d0b5f051-d3ce-4c74-a270-73f0a4eb48f6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:05.177120 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d0b5f051-d3ce-4c74-a270-73f0a4eb48f6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:05.185562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d0b5f051-d3ce-4c74-a270-73f0a4eb48f6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.182045 Aug 30 01:59:05.186751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 231/460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:05 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:05.579946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:05.581231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:05.590048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:05.591604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:05.592146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:05.592988 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:05.593667 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:05.594194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:05.748390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:05.757876 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:05.759414 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:05.760904 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b5687df6-d565-4fd9-9bc4-63202cacd3ba tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.184704 Aug 30 01:59:05.776551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 230/461] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:05 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:06.207624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-85bd90a4-0455-46ea-a1db-348e504036ab tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:06.209097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-85bd90a4-0455-46ea-a1db-348e504036ab tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:06.216265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85bd90a4-0455-46ea-a1db-348e504036ab tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:06.216744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85bd90a4-0455-46ea-a1db-348e504036ab tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:06.217174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85bd90a4-0455-46ea-a1db-348e504036ab tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:06.217861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85bd90a4-0455-46ea-a1db-348e504036ab tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:06.218316 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85bd90a4-0455-46ea-a1db-348e504036ab tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:06.218759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85bd90a4-0455-46ea-a1db-348e504036ab tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:06.368205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-85bd90a4-0455-46ea-a1db-348e504036ab tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:06.379489 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-85bd90a4-0455-46ea-a1db-348e504036ab tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1501 microversion: 2.1 time: 0.175311 Aug 30 01:59:06.381715 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 232/462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:06 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:06.401435 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47f41a4e-5d35-44eb-9a31-dd4a49c4cc7b"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:06.403786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:06.410368 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:06.411109 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:06.411587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:06.412500 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:06.413150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:06.413770 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:06.439647 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] HTTP exception thrown: Cannot 'attach_volume' instance 48eb7084-94aa-46f2-911d-ca2463bfb25c while it is in vm_state rescued Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Request method failure captured: Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: POST /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c/os-volume_attachments HTTP/1.1 Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 74 Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW6CH7rafVDf4Z49atCLViZ3JqK9FndKwadpATmAmjejXk-UMRbD6IDWbAEx9isb3LOGqCn3HFUiYljZOMTtY27lIE59l05A16SAbSpwxTuNaNf8VE8NsWO8DEt-mYiMRkVjGpfCnCmkLjQIxdO90EaVSI7HOs-2sZqlS7yDVykN_Iw Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 688f10cbc5ce42b895bb7a9285749cca Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 01:59:06.441881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_688f10cbc5ce42b895bb7a9285749cca"}]}] Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 688f10cbc5ce42b895bb7a9285749cca Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-ServerRescueNegativeTestJSON-108033553-project Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 86f364f03c7d4360b4a75ed194846ade Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-ServerRescueNegativeTestJSON-108033553-project Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {"volumeAttachment": {"volumeId": "47f41a4e-5d35-44eb-9a31-dd4a49c4cc7b"}} Aug 30 01:59:06.444106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Cannot 'attach_volume' instance 48eb7084-94aa-46f2-911d-ca2463bfb25c while it is in vm_state rescued Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'server_id': '48eb7084-94aa-46f2-911d-ca2463bfb25c', 'body': {'volumeAttachment': {'volumeId': '47f41a4e-5d35-44eb-9a31-dd4a49c4cc7b'}}} Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48eb7084-94aa-46f2-911d-ca2463bfb25c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:59:06.445084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 48eb7084-94aa-46f2-911d-ca2463bfb25c while it is in vm_state rescued Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:59:06.446542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:59:06.448381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:59:06.448381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:59:06.448381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 48eb7084-94aa-46f2-911d-ca2463bfb25c while it is in vm_state rescued Aug 30 01:59:06.448381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 01:59:06.449407 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Returning 409 to user: Cannot 'attach_volume' instance 48eb7084-94aa-46f2-911d-ca2463bfb25c while it is in vm_state rescued {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:59:06.450256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-994fc978-37d4-4110-a0b2-2acbd1d8c995 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052917 Aug 30 01:59:06.452594 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 231/463] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 01:59:06 2022] POST /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:59:06.460919 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4df62990-3710-4f47-bbc0-6510a85395dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:06.461529 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4df62990-3710-4f47-bbc0-6510a85395dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:06.470029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4df62990-3710-4f47-bbc0-6510a85395dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:06.470789 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4df62990-3710-4f47-bbc0-6510a85395dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:06.471400 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4df62990-3710-4f47-bbc0-6510a85395dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:06.472543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4df62990-3710-4f47-bbc0-6510a85395dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:06.473433 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4df62990-3710-4f47-bbc0-6510a85395dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:06.474428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4df62990-3710-4f47-bbc0-6510a85395dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:06.478491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:06.558497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4df62990-3710-4f47-bbc0-6510a85395dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c/action" status: 202 len: 0 microversion: 2.1 time: 0.102602 Aug 30 01:59:06.562428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 233/464] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 01:59:06 2022] POST /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:59:06.573614 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-492ae2f2-d025-4fb2-ae7f-dbf5aa1a8cb3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:06.574839 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-492ae2f2-d025-4fb2-ae7f-dbf5aa1a8cb3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:06.586492 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-492ae2f2-d025-4fb2-ae7f-dbf5aa1a8cb3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:06.588124 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-492ae2f2-d025-4fb2-ae7f-dbf5aa1a8cb3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:06.589110 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-492ae2f2-d025-4fb2-ae7f-dbf5aa1a8cb3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:06.590600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-492ae2f2-d025-4fb2-ae7f-dbf5aa1a8cb3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:06.591319 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-492ae2f2-d025-4fb2-ae7f-dbf5aa1a8cb3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:06.592014 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-492ae2f2-d025-4fb2-ae7f-dbf5aa1a8cb3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:06.787241 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:06.791592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:06.802330 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:06.803439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:06.804192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:06.805665 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:06.806473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:06.807723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:06.960191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-492ae2f2-d025-4fb2-ae7f-dbf5aa1a8cb3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:06.967912 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-492ae2f2-d025-4fb2-ae7f-dbf5aa1a8cb3 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1509 microversion: 2.1 time: 0.402092 Aug 30 01:59:06.968516 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 232/465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:06 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:07.003936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:07.026728 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:07.028522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:07.031644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8fcf65c6-c155-470e-acfe-35c03a5600b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.251182 Aug 30 01:59:07.032776 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 234/466] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:06 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:07.993703 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-93816d0b-464c-4c36-80a7-5654e89561a0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:07.995201 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-93816d0b-464c-4c36-80a7-5654e89561a0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:08.001995 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-93816d0b-464c-4c36-80a7-5654e89561a0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:08.002776 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-93816d0b-464c-4c36-80a7-5654e89561a0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:08.003445 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-93816d0b-464c-4c36-80a7-5654e89561a0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:08.004690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-93816d0b-464c-4c36-80a7-5654e89561a0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:08.006047 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-93816d0b-464c-4c36-80a7-5654e89561a0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:08.006711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-93816d0b-464c-4c36-80a7-5654e89561a0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:08.057421 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:08.058109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:08.064711 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:08.065417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:08.065846 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:08.066532 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:08.066979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:08.067560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:08.155629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-93816d0b-464c-4c36-80a7-5654e89561a0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:08.164380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-93816d0b-464c-4c36-80a7-5654e89561a0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1509 microversion: 2.1 time: 0.175789 Aug 30 01:59:08.166165 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 233/467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:07 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:08.234180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:08.245207 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:08.246971 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:08.248153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0abbea8a-106e-4885-aab9-8e1ec87b5ba5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.194577 Aug 30 01:59:08.267943 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 235/468] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:08 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:09.190753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5240c8a0-d083-41e5-b9c0-d46675a28a14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:09.192195 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5240c8a0-d083-41e5-b9c0-d46675a28a14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:09.199516 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5240c8a0-d083-41e5-b9c0-d46675a28a14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:09.200263 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5240c8a0-d083-41e5-b9c0-d46675a28a14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:09.200915 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5240c8a0-d083-41e5-b9c0-d46675a28a14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:09.201806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5240c8a0-d083-41e5-b9c0-d46675a28a14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:09.202442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5240c8a0-d083-41e5-b9c0-d46675a28a14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:09.203052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5240c8a0-d083-41e5-b9c0-d46675a28a14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:09.275807 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:09.276684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:09.303689 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:09.305040 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:09.305769 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:09.307607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:09.308851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:09.309815 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:09.344972 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5240c8a0-d083-41e5-b9c0-d46675a28a14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:09.354086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5240c8a0-d083-41e5-b9c0-d46675a28a14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1509 microversion: 2.1 time: 0.167167 Aug 30 01:59:09.354950 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 234/469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:09 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:09.488831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:09.497495 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:09.498836 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:09.499963 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-222f1d2a-e202-468a-b08b-8cac6bd175fc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.228595 Aug 30 01:59:09.500916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 236/470] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:09 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:10.380453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-50819464-8ec1-41fe-a0c5-3b838923db8f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:10.381825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-50819464-8ec1-41fe-a0c5-3b838923db8f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:10.389248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50819464-8ec1-41fe-a0c5-3b838923db8f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:10.389999 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50819464-8ec1-41fe-a0c5-3b838923db8f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:10.390663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50819464-8ec1-41fe-a0c5-3b838923db8f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:10.391480 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50819464-8ec1-41fe-a0c5-3b838923db8f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:10.392001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50819464-8ec1-41fe-a0c5-3b838923db8f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:10.392533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50819464-8ec1-41fe-a0c5-3b838923db8f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:10.523833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:10.525144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:10.531333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:10.532014 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:10.532658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:10.533731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:10.534354 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:10.534783 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:10.546216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-50819464-8ec1-41fe-a0c5-3b838923db8f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:10.555789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-50819464-8ec1-41fe-a0c5-3b838923db8f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1509 microversion: 2.1 time: 0.179531 Aug 30 01:59:10.574195 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 235/471] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:10 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:10.689431 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:10.698007 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:10.699440 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:10.700633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-acb8ed5d-db4e-4b17-a0be-3699bed5f04c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.181562 Aug 30 01:59:10.701166 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 237/472] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:10 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:11.580913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e82a36c1-12de-4a3c-994c-0f74e7ecc419 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:11.582465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e82a36c1-12de-4a3c-994c-0f74e7ecc419 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:11.591602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e82a36c1-12de-4a3c-994c-0f74e7ecc419 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:11.592571 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e82a36c1-12de-4a3c-994c-0f74e7ecc419 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:11.593430 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e82a36c1-12de-4a3c-994c-0f74e7ecc419 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:11.594778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e82a36c1-12de-4a3c-994c-0f74e7ecc419 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:11.595387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e82a36c1-12de-4a3c-994c-0f74e7ecc419 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:11.596034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e82a36c1-12de-4a3c-994c-0f74e7ecc419 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:11.724737 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:11.725372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:11.732570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:11.733215 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:11.733754 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:11.734592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:11.735153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:11.735752 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:11.777937 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e82a36c1-12de-4a3c-994c-0f74e7ecc419 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:11.799754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e82a36c1-12de-4a3c-994c-0f74e7ecc419 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1515 microversion: 2.1 time: 0.222004 Aug 30 01:59:11.799754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 236/473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:11 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:11.966571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:11.982813 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:11.985844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:11.987212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d988bda1-b997-480a-a86f-6e7f895b514f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.267974 Aug 30 01:59:11.988644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 238/474] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:11 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:13.011169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:13.011961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:13.018437 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:13.018996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:13.019497 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:13.020343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:13.020939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:13.021928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:13.154566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:13.162459 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:13.163886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:13.165045 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-700e995f-2d3a-4b28-a9e4-a37e4f8b6ccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.157782 Aug 30 01:59:13.165596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 237/475] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:13 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:14.187958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:14.189153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:14.196635 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:14.197562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:14.197791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:14.198417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:14.198868 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:14.199290 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:14.347324 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:14.350171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e8b2e2ba-faed-438b-9fe8-413a8f13e7c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'create', calling method: .version_select at 0x7f3b08206700>, body: {"keypair": {"name": "tempest-keypair-682494787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdDbgRkjFdKh+hVwf1bTy8xIx3al+15GsoUX6//P8u0qdeEVGSIk0HzV8Q5zKr6VpY3bZuV2a3lvkIOcrNnZog4pBKStfivYbfSAKGAieAQV16QJbK/tx668jL5pY7uXg=="}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:14.356491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:14.357965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:14.359133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a560db5d-51bf-49cc-815a-cd72e2a4dc6f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.175126 Aug 30 01:59:14.359681 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 239/476] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:14 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:14.368164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-e8b2e2ba-faed-438b-9fe8-413a8f13e7c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Getting quotas for project 688f10cbc5ce42b895bb7a9285749cca. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:59:14.372426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-e8b2e2ba-faed-438b-9fe8-413a8f13e7c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Getting quotas for user 86f364f03c7d4360b4a75ed194846ade and project 688f10cbc5ce42b895bb7a9285749cca. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:59:14.397252 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e8b2e2ba-faed-438b-9fe8-413a8f13e7c4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051893 Aug 30 01:59:14.398393 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 238/477] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 01:59:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:59:15.384547 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:15.385298 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:15.392566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:15.393499 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:15.393940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:15.395159 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:15.395624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:15.396520 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:15.607132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:15.616894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:15.618453 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:15.619617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cc803a59-6673-4186-8db9-d948b2f0139a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.239613 Aug 30 01:59:15.633026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 240/478] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:15 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:15.699697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1778294905", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22623ea0-0f64-4b42-91fc-13e8bf6bfe27"}], "security_groups": [{"name": "tempest-securitygroup--60201656"}], "key_name": "tempest-keypair-682494787", "user_data": "}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:15.840983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.network.neutron [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] validate_networks() for [('22623ea0-0f64-4b42-91fc-13e8bf6bfe27', None, None, None, None, None)] {{(pid=120391) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:59:16.289509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Flavor limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:59:16.289509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Image limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:59:16.289509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Flavor pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:59:16.289509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Image pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:59:16.289509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:59:16.300735 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:16.301227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:16.301659 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:16.302420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:16.302875 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:16.303297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:16.323832 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Getting quotas for project 688f10cbc5ce42b895bb7a9285749cca. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:59:16.328929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Getting quotas for user 86f364f03c7d4360b4a75ed194846ade and project 688f10cbc5ce42b895bb7a9285749cca. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:59:16.341079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Going to run 1 instances... {{(pid=120391) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:59:16.343397 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:59:16.392289 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7839d05d-c6c2-445a-965c-c0e96043e78c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.696791 Aug 30 01:59:16.392924 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 239/479] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:59:15 2022] POST /compute/v2.1/servers => generated 407 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:59:16.404824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d81898c9-14ed-4990-b28c-40381be7da08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:16.405630 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d81898c9-14ed-4990-b28c-40381be7da08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:16.464002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d81898c9-14ed-4990-b28c-40381be7da08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:16.471211 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d81898c9-14ed-4990-b28c-40381be7da08 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1245 microversion: 2.1 time: 0.070944 Aug 30 01:59:16.471937 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 241/480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:16 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:16.645429 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:16.646602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:16.652824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:16.653306 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:16.653740 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:16.654428 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:16.655024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:16.655448 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:16.802492 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:16.810902 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:16.812768 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:16.813998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ad786ee5-34d7-4fc6-a50e-b558dd793c01 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.172873 Aug 30 01:59:16.814721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 240/481] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:16 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:17.312135 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7eedab22-6b77-4a54-8978-cc61777af357 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:17.312692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7eedab22-6b77-4a54-8978-cc61777af357 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:17.319105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7eedab22-6b77-4a54-8978-cc61777af357 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:17.319587 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7eedab22-6b77-4a54-8978-cc61777af357 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:17.320024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7eedab22-6b77-4a54-8978-cc61777af357 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:17.320781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7eedab22-6b77-4a54-8978-cc61777af357 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:17.321366 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7eedab22-6b77-4a54-8978-cc61777af357 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:17.321801 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7eedab22-6b77-4a54-8978-cc61777af357 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:17.347266 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7eedab22-6b77-4a54-8978-cc61777af357 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/ips" status: 200 len: 148 microversion: 2.1 time: 0.038917 Aug 30 01:59:17.347816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 242/482] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 01:59:17 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:59:17.494622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-df559587-08f6-4beb-868f-7a65a36e33dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:17.495533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-df559587-08f6-4beb-868f-7a65a36e33dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:17.502449 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-df559587-08f6-4beb-868f-7a65a36e33dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:17.503133 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-df559587-08f6-4beb-868f-7a65a36e33dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:17.504210 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-df559587-08f6-4beb-868f-7a65a36e33dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:17.505111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-df559587-08f6-4beb-868f-7a65a36e33dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:17.505743 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-df559587-08f6-4beb-868f-7a65a36e33dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:17.506265 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-df559587-08f6-4beb-868f-7a65a36e33dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:17.573610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-df559587-08f6-4beb-868f-7a65a36e33dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:17.582264 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-df559587-08f6-4beb-868f-7a65a36e33dd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1249 microversion: 2.1 time: 0.091895 Aug 30 01:59:17.583788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 241/483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:17 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:17.838141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:17.838850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:17.845571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:17.846048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:17.846472 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:17.847144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:17.847584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:17.847998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:17.977034 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:17.985102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:17.986553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:17.987693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-28e3cd64-ce99-461c-b68d-17d52cbef97f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.153597 Aug 30 01:59:17.988250 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 243/484] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:17 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:18.604516 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c623378f-7e24-4c93-81db-c5eab4f1113e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:18.605131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c623378f-7e24-4c93-81db-c5eab4f1113e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:18.612623 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c623378f-7e24-4c93-81db-c5eab4f1113e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:18.613100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c623378f-7e24-4c93-81db-c5eab4f1113e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:18.613527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c623378f-7e24-4c93-81db-c5eab4f1113e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:18.614211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c623378f-7e24-4c93-81db-c5eab4f1113e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:18.615153 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c623378f-7e24-4c93-81db-c5eab4f1113e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:18.615573 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c623378f-7e24-4c93-81db-c5eab4f1113e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:18.675520 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c623378f-7e24-4c93-81db-c5eab4f1113e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:18.683587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c623378f-7e24-4c93-81db-c5eab4f1113e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1249 microversion: 2.1 time: 0.082933 Aug 30 01:59:18.684140 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 242/485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:18 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:19.010973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:19.011560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:19.017978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:19.018454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:19.018881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:19.019561 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:19.020007 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:19.020463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:19.147476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:19.155414 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:19.156885 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:19.158025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b4a732fd-2006-42e2-9240-76569a6e191d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.151023 Aug 30 01:59:19.158572 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 244/486] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:19 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:19.704521 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-89877c4b-03ee-4807-ae0a-4de555dc6557 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:19.704912 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-89877c4b-03ee-4807-ae0a-4de555dc6557 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:19.711184 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-89877c4b-03ee-4807-ae0a-4de555dc6557 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:19.711699 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-89877c4b-03ee-4807-ae0a-4de555dc6557 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:19.712376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-89877c4b-03ee-4807-ae0a-4de555dc6557 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:19.713160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-89877c4b-03ee-4807-ae0a-4de555dc6557 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:19.713621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-89877c4b-03ee-4807-ae0a-4de555dc6557 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:19.714047 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-89877c4b-03ee-4807-ae0a-4de555dc6557 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:19.786323 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-89877c4b-03ee-4807-ae0a-4de555dc6557 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:19.794703 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-89877c4b-03ee-4807-ae0a-4de555dc6557 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1241 microversion: 2.1 time: 0.095100 Aug 30 01:59:19.795256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 243/487] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:19 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:20.180906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:20.181651 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:20.187957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:20.188586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:20.189020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:20.189704 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:20.190151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:20.190570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:20.320712 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:20.328919 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:20.330364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:20.331518 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fa41b788-684d-4039-b2f5-d0f48ddb8804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.155143 Aug 30 01:59:20.332064 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 245/488] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:20 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:20.814923 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-eab8b30f-6eb4-48c4-b460-37bcfa896e77 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:20.815532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-eab8b30f-6eb4-48c4-b460-37bcfa896e77 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:20.822318 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eab8b30f-6eb4-48c4-b460-37bcfa896e77 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:20.822798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eab8b30f-6eb4-48c4-b460-37bcfa896e77 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:20.823228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eab8b30f-6eb4-48c4-b460-37bcfa896e77 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:20.823920 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eab8b30f-6eb4-48c4-b460-37bcfa896e77 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:20.824401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eab8b30f-6eb4-48c4-b460-37bcfa896e77 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:20.824822 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eab8b30f-6eb4-48c4-b460-37bcfa896e77 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:20.895360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-eab8b30f-6eb4-48c4-b460-37bcfa896e77 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:20.904660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-eab8b30f-6eb4-48c4-b460-37bcfa896e77 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1297 microversion: 2.1 time: 0.093515 Aug 30 01:59:20.905388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 244/489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:20 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:21.355046 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:21.355821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:21.363310 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:21.363805 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:21.364264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:21.372531 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:21.373294 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:21.374024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:21.519138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:21.527041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:21.528488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:21.529647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-11a623e1-04f0-4e8e-a576-a6cfe1fe870e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.179144 Aug 30 01:59:21.530196 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 246/490] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:21 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:21.926529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cc545981-dcc7-48f2-b596-24a10aad061f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:21.936765 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cc545981-dcc7-48f2-b596-24a10aad061f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:21.936765 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc545981-dcc7-48f2-b596-24a10aad061f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:21.936765 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc545981-dcc7-48f2-b596-24a10aad061f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:21.936765 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc545981-dcc7-48f2-b596-24a10aad061f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:21.937253 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc545981-dcc7-48f2-b596-24a10aad061f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:21.937253 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc545981-dcc7-48f2-b596-24a10aad061f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:21.937426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc545981-dcc7-48f2-b596-24a10aad061f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:21.949409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0e80f197-9a56-44fa-b021-d37fa1e191d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13ce3103-585a-4205-84e3-1d93ffc48741"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:21.951816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0e80f197-9a56-44fa-b021-d37fa1e191d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:21.953814 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=56 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:21.960612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e80f197-9a56-44fa-b021-d37fa1e191d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:21.961154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e80f197-9a56-44fa-b021-d37fa1e191d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:21.961646 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e80f197-9a56-44fa-b021-d37fa1e191d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:21.962379 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e80f197-9a56-44fa-b021-d37fa1e191d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:21.962832 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e80f197-9a56-44fa-b021-d37fa1e191d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:21.963254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e80f197-9a56-44fa-b021-d37fa1e191d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:22.002073 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cc545981-dcc7-48f2-b596-24a10aad061f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:22.010122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cc545981-dcc7-48f2-b596-24a10aad061f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1303 microversion: 2.1 time: 0.087734 Aug 30 01:59:22.010688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 245/491] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:21 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:22.551767 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:22.552304 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:22.558207 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:22.558684 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:22.559115 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:22.559798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:22.560270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:22.560698 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:22.733332 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:22.748083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:22.749621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:22.750777 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1eb4fae0-bee7-478d-97cb-72f640013d46 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.203049 Aug 30 01:59:22.751329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 246/492] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:22 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:23.031150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-611e3e39-b40f-4484-89b5-7b9bdd8e2dce tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:23.031783 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-611e3e39-b40f-4484-89b5-7b9bdd8e2dce tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:23.034059 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:23.040441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-611e3e39-b40f-4484-89b5-7b9bdd8e2dce tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:23.041022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-611e3e39-b40f-4484-89b5-7b9bdd8e2dce tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:23.041524 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-611e3e39-b40f-4484-89b5-7b9bdd8e2dce tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:23.042323 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-611e3e39-b40f-4484-89b5-7b9bdd8e2dce tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:23.042965 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-611e3e39-b40f-4484-89b5-7b9bdd8e2dce tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:23.043487 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-611e3e39-b40f-4484-89b5-7b9bdd8e2dce tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:23.179175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-611e3e39-b40f-4484-89b5-7b9bdd8e2dce tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:23.186657 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-611e3e39-b40f-4484-89b5-7b9bdd8e2dce tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.159441 Aug 30 01:59:23.187211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 247/493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:23 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:23.774163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:23.774761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:23.780626 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:23.781102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:23.781527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:23.782198 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:23.782642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:23.783056 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:23.785590 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:23.910932 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:23.919417 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:23.920895 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:23.922074 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-62c645a3-388b-43da-8b62-6b3d2d3f0af9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.151868 Aug 30 01:59:23.922841 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 248/494] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:23 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:24.207240 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ba858d9d-7633-4b14-847b-a0048733e92e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:24.207855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ba858d9d-7633-4b14-847b-a0048733e92e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:24.214114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ba858d9d-7633-4b14-847b-a0048733e92e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:24.214599 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ba858d9d-7633-4b14-847b-a0048733e92e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:24.215043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ba858d9d-7633-4b14-847b-a0048733e92e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:24.215727 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ba858d9d-7633-4b14-847b-a0048733e92e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:24.216186 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ba858d9d-7633-4b14-847b-a0048733e92e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:24.216631 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ba858d9d-7633-4b14-847b-a0048733e92e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:24.346256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ba858d9d-7633-4b14-847b-a0048733e92e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:24.354529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ba858d9d-7633-4b14-847b-a0048733e92e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.151213 Aug 30 01:59:24.355083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 249/495] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:24 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:24.455036 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0eb7e156-bd62-4b82-bd2f-2edf9bb5bcfa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:24.455527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0eb7e156-bd62-4b82-bd2f-2edf9bb5bcfa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:24.462104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0eb7e156-bd62-4b82-bd2f-2edf9bb5bcfa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:24.462524 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0eb7e156-bd62-4b82-bd2f-2edf9bb5bcfa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:24.462961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0eb7e156-bd62-4b82-bd2f-2edf9bb5bcfa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:24.463653 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0eb7e156-bd62-4b82-bd2f-2edf9bb5bcfa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:24.464106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0eb7e156-bd62-4b82-bd2f-2edf9bb5bcfa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:24.464560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0eb7e156-bd62-4b82-bd2f-2edf9bb5bcfa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:24.488070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0eb7e156-bd62-4b82-bd2f-2edf9bb5bcfa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/ips" status: 200 len: 146 microversion: 2.1 time: 0.036884 Aug 30 01:59:24.488672 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 250/496] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 01:59:24 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:59:24.949482 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:24.950122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:24.956398 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:24.956733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:24.957084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:24.958247 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:24.958247 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:24.958715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:25.090223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:25.098095 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:25.099525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:25.100766 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-99a26055-d186-42bb-bd89-d42d875c5932 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.155200 Aug 30 01:59:25.101311 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 251/497] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:24 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:25.374919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9197e804-5e80-4479-a382-07a64ac7d823 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:25.375534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9197e804-5e80-4479-a382-07a64ac7d823 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:25.382212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9197e804-5e80-4479-a382-07a64ac7d823 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:25.382702 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9197e804-5e80-4479-a382-07a64ac7d823 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:25.383129 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9197e804-5e80-4479-a382-07a64ac7d823 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:25.383822 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9197e804-5e80-4479-a382-07a64ac7d823 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:25.384300 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9197e804-5e80-4479-a382-07a64ac7d823 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:25.384727 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9197e804-5e80-4479-a382-07a64ac7d823 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:25.731023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9197e804-5e80-4479-a382-07a64ac7d823 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:25.739547 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9197e804-5e80-4479-a382-07a64ac7d823 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.368457 Aug 30 01:59:25.740090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 252/498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:25 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:26.124450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:26.125052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:26.131073 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:26.132048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:26.132507 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:26.133180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:26.133624 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:26.134041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:26.255985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:26.264355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:26.265786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:26.266925 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-12efa139-de4a-4c03-9ea4-722dc0f46f71 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.146340 Aug 30 01:59:26.267472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 253/499] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:26 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:26.469087 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:26.761828 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d2ffa990-9065-4439-bb52-7afebddce764 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:26.762431 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d2ffa990-9065-4439-bb52-7afebddce764 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:26.764266 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:26.764895 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=10 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:26.771107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d2ffa990-9065-4439-bb52-7afebddce764 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:26.771582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d2ffa990-9065-4439-bb52-7afebddce764 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:26.772012 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d2ffa990-9065-4439-bb52-7afebddce764 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:26.772720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d2ffa990-9065-4439-bb52-7afebddce764 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:26.773170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d2ffa990-9065-4439-bb52-7afebddce764 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:26.773585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d2ffa990-9065-4439-bb52-7afebddce764 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:26.908652 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d2ffa990-9065-4439-bb52-7afebddce764 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:26.917320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d2ffa990-9065-4439-bb52-7afebddce764 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.159405 Aug 30 01:59:26.917866 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 254/500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:26 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:27.290156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:27.290762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:27.296744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:27.297220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:27.297649 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:27.298796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:27.298796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:27.299171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:27.424590 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:27.433023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:27.434462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:27.435595 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a7222886-5782-45a1-af04-33f162b702cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.149432 Aug 30 01:59:27.436149 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 255/501] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:27 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:27.938404 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8762947d-8c76-4282-b047-ec009cf5fce1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:27.939048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8762947d-8c76-4282-b047-ec009cf5fce1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:27.945974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8762947d-8c76-4282-b047-ec009cf5fce1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:27.946454 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8762947d-8c76-4282-b047-ec009cf5fce1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:27.946884 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8762947d-8c76-4282-b047-ec009cf5fce1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:27.947571 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8762947d-8c76-4282-b047-ec009cf5fce1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:27.948024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8762947d-8c76-4282-b047-ec009cf5fce1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:27.948478 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8762947d-8c76-4282-b047-ec009cf5fce1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:28.074720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8762947d-8c76-4282-b047-ec009cf5fce1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:28.082151 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8762947d-8c76-4282-b047-ec009cf5fce1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.147725 Aug 30 01:59:28.082696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 256/502] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:27 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:28.458772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:28.459305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:28.465274 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:28.465744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:28.466164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:28.466833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:28.467279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:28.467693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:28.595829 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:28.604254 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:28.605704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:28.606885 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1f96e61e-dbad-4123-ba37-b9d896330d99 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.152060 Aug 30 01:59:28.607429 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 257/503] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:28 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:29.102617 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6cee8337-ba55-47f0-8b77-02be9660860b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:29.103217 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6cee8337-ba55-47f0-8b77-02be9660860b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:29.110020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cee8337-ba55-47f0-8b77-02be9660860b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:29.110578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cee8337-ba55-47f0-8b77-02be9660860b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:29.111379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cee8337-ba55-47f0-8b77-02be9660860b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:29.112154 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cee8337-ba55-47f0-8b77-02be9660860b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:29.112673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cee8337-ba55-47f0-8b77-02be9660860b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:29.113257 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cee8337-ba55-47f0-8b77-02be9660860b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:29.211622 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0e80f197-9a56-44fa-b021-d37fa1e191d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.265142 Aug 30 01:59:29.214633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 247/504] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 01:59:21 2022] POST /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments => generated 194 bytes in 7268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:59:29.367137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6cee8337-ba55-47f0-8b77-02be9660860b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:29.379875 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6cee8337-ba55-47f0-8b77-02be9660860b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.280609 Aug 30 01:59:29.380962 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 258/505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:29 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:29.631326 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:29.632636 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:29.639456 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:29.639934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:29.640390 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:29.641076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:29.641684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:29.642251 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:29.768858 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-9cbe4f06-38ce-4f9d-88c7-7a59a81435a7 req-6e227133-3a51-4a75-9426-007eb39d4398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9adad9-3583-4b2c-bb23-b55ab2c97b2c", "tag": "23743ca1-3a9e-4a05-9026-c437ca9a2dec"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:29.775737 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:29.779271 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9cbe4f06-38ce-4f9d-88c7-7a59a81435a7 req-6e227133-3a51-4a75-9426-007eb39d4398 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:29.779886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9cbe4f06-38ce-4f9d-88c7-7a59a81435a7 req-6e227133-3a51-4a75-9426-007eb39d4398 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:29.780343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9cbe4f06-38ce-4f9d-88c7-7a59a81435a7 req-6e227133-3a51-4a75-9426-007eb39d4398 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:29.782249 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:29.785865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:29.787407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:29.788771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-26ba1a4b-7633-4143-9cd5-ba5063d485bf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.162359 Aug 30 01:59:29.789521 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 248/506] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:29 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:29.792267 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-9cbe4f06-38ce-4f9d-88c7-7a59a81435a7 req-6e227133-3a51-4a75-9426-007eb39d4398 service nova] Creating event network-changed:23743ca1-3a9e-4a05-9026-c437ca9a2dec for instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c on hv-cinder-81966 Aug 30 01:59:29.797155 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-9cbe4f06-38ce-4f9d-88c7-7a59a81435a7 req-6e227133-3a51-4a75-9426-007eb39d4398 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032461 Aug 30 01:59:29.798163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 259/507] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:59:30.403052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5f9af30c-c1b0-41fc-b770-78e04ac7c370 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:30.403862 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5f9af30c-c1b0-41fc-b770-78e04ac7c370 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:30.413053 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f9af30c-c1b0-41fc-b770-78e04ac7c370 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:30.413653 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f9af30c-c1b0-41fc-b770-78e04ac7c370 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:30.414745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f9af30c-c1b0-41fc-b770-78e04ac7c370 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:30.415510 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f9af30c-c1b0-41fc-b770-78e04ac7c370 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:30.415958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f9af30c-c1b0-41fc-b770-78e04ac7c370 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:30.416417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5f9af30c-c1b0-41fc-b770-78e04ac7c370 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:30.562567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5f9af30c-c1b0-41fc-b770-78e04ac7c370 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:30.573311 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5f9af30c-c1b0-41fc-b770-78e04ac7c370 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.175311 Aug 30 01:59:30.573886 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 249/508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:30 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:30.813849 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:30.814567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:30.824817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:30.825705 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:30.826376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:30.827501 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:30.827956 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:30.828420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:31.044721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:31.052763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:31.054220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:31.055864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9f740deb-5283-4b9f-aaeb-0683fb557c6b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.246399 Aug 30 01:59:31.056445 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 260/509] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:30 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:31.473296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-95794c93-8728-424b-ad62-40a6287d9016 req-b23d595f-7216-4a1e-945b-a9bba16400f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51036535-5cf5-4283-b501-b0809e3f57a6", "name": "network-vif-plugged", "status": "completed", "tag": "b76470f7-925f-4c0c-b128-d7b4fbc6e636"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:31.485441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-95794c93-8728-424b-ad62-40a6287d9016 req-b23d595f-7216-4a1e-945b-a9bba16400f4 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:31.485927 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-95794c93-8728-424b-ad62-40a6287d9016 req-b23d595f-7216-4a1e-945b-a9bba16400f4 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:31.486379 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-95794c93-8728-424b-ad62-40a6287d9016 req-b23d595f-7216-4a1e-945b-a9bba16400f4 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:31.498020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-95794c93-8728-424b-ad62-40a6287d9016 req-b23d595f-7216-4a1e-945b-a9bba16400f4 service nova] Creating event network-vif-plugged:b76470f7-925f-4c0c-b128-d7b4fbc6e636 for instance 51036535-5cf5-4283-b501-b0809e3f57a6 on hv-cinder-81966 Aug 30 01:59:31.502750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-95794c93-8728-424b-ad62-40a6287d9016 req-b23d595f-7216-4a1e-945b-a9bba16400f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034074 Aug 30 01:59:31.503513 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 250/510] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:59:31.594447 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1a488fa3-898a-45c8-b057-e94fea509609 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:31.595087 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1a488fa3-898a-45c8-b057-e94fea509609 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:31.600975 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a488fa3-898a-45c8-b057-e94fea509609 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:31.601456 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a488fa3-898a-45c8-b057-e94fea509609 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:31.601886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a488fa3-898a-45c8-b057-e94fea509609 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:31.602568 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a488fa3-898a-45c8-b057-e94fea509609 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:31.603018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a488fa3-898a-45c8-b057-e94fea509609 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:31.603442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a488fa3-898a-45c8-b057-e94fea509609 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:31.730280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1a488fa3-898a-45c8-b057-e94fea509609 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:31.738812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1a488fa3-898a-45c8-b057-e94fea509609 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.148110 Aug 30 01:59:31.739385 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 261/511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:31 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:31.740332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2c873bb2-b8f2-4b72-95d3-ded3f074d27a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4b63aed-9e3c-4893-8b8a-031b74453822"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:31.742791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2c873bb2-b8f2-4b72-95d3-ded3f074d27a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:31.749770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c873bb2-b8f2-4b72-95d3-ded3f074d27a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:31.750337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c873bb2-b8f2-4b72-95d3-ded3f074d27a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:31.750850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c873bb2-b8f2-4b72-95d3-ded3f074d27a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:31.751615 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c873bb2-b8f2-4b72-95d3-ded3f074d27a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:31.752163 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c873bb2-b8f2-4b72-95d3-ded3f074d27a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:31.752681 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c873bb2-b8f2-4b72-95d3-ded3f074d27a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:32.078896 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:32.079534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:32.086094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:32.086576 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:32.087026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:32.087711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:32.088161 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:32.088612 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:32.217741 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:32.225643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:32.227067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:32.228197 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3d8215f8-1087-47d2-83bf-01ef44eb4069 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.153228 Aug 30 01:59:32.228772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 262/512] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:32 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:32.760709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5ce38b08-d43d-4d97-9ff6-bf17afe53600 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:32.761528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5ce38b08-d43d-4d97-9ff6-bf17afe53600 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:32.767403 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce38b08-d43d-4d97-9ff6-bf17afe53600 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:32.767874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce38b08-d43d-4d97-9ff6-bf17afe53600 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:32.768337 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce38b08-d43d-4d97-9ff6-bf17afe53600 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:32.769007 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce38b08-d43d-4d97-9ff6-bf17afe53600 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:32.769451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce38b08-d43d-4d97-9ff6-bf17afe53600 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:32.769868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce38b08-d43d-4d97-9ff6-bf17afe53600 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:32.899606 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ce38b08-d43d-4d97-9ff6-bf17afe53600 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:32.907851 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5ce38b08-d43d-4d97-9ff6-bf17afe53600 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.151129 Aug 30 01:59:32.908762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 263/513] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:32 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:33.250720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:33.251361 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:33.257564 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:33.258040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:33.258472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:33.259154 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:33.259607 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:33.260071 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:33.392844 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:33.401208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:33.402639 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:33.403834 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b28ccd63-b9a5-4a78-b3d6-5ebf03926f49 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.157041 Aug 30 01:59:33.404410 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 264/514] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:33 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:33.929667 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-68fb3678-7d77-4018-abdd-15d1ebcf7cfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:33.930187 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-68fb3678-7d77-4018-abdd-15d1ebcf7cfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:33.937317 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68fb3678-7d77-4018-abdd-15d1ebcf7cfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:33.937887 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68fb3678-7d77-4018-abdd-15d1ebcf7cfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:33.938334 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68fb3678-7d77-4018-abdd-15d1ebcf7cfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:33.939007 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68fb3678-7d77-4018-abdd-15d1ebcf7cfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:33.939453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68fb3678-7d77-4018-abdd-15d1ebcf7cfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:33.939868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68fb3678-7d77-4018-abdd-15d1ebcf7cfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:34.066546 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-68fb3678-7d77-4018-abdd-15d1ebcf7cfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:34.068807 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:34.075865 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-68fb3678-7d77-4018-abdd-15d1ebcf7cfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.150097 Aug 30 01:59:34.076514 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 265/515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:33 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:34.429555 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:34.430153 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:34.436793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:34.437263 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:34.437686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:34.438358 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:34.438806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:34.439219 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:34.568116 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:34.576324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:34.577790 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:34.578959 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-788f0a0e-cb96-4bc3-a1b7-3799aa5d90ff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.153256 Aug 30 01:59:34.579504 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 266/516] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:34 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:35.096517 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-67c3f92b-2af9-4ec7-8b1c-0f9b159ddf5b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:35.097117 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-67c3f92b-2af9-4ec7-8b1c-0f9b159ddf5b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:35.103408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67c3f92b-2af9-4ec7-8b1c-0f9b159ddf5b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:35.103881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67c3f92b-2af9-4ec7-8b1c-0f9b159ddf5b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:35.104335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67c3f92b-2af9-4ec7-8b1c-0f9b159ddf5b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:35.105016 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67c3f92b-2af9-4ec7-8b1c-0f9b159ddf5b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:35.105460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67c3f92b-2af9-4ec7-8b1c-0f9b159ddf5b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:35.105874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67c3f92b-2af9-4ec7-8b1c-0f9b159ddf5b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:35.234695 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-67c3f92b-2af9-4ec7-8b1c-0f9b159ddf5b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:35.242146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-67c3f92b-2af9-4ec7-8b1c-0f9b159ddf5b tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.149581 Aug 30 01:59:35.242715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 267/517] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:35 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:35.602140 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:35.603604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:35.610953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:35.611441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:35.611907 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:35.612635 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:35.613090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:35.613527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:35.743027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:35.751327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:35.752799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:35.754036 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3cbbd0c1-1e06-4d2e-af7e-a2f81e3837bb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.156105 Aug 30 01:59:35.754838 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 268/518] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:35 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:36.263445 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5956556f-3c67-4203-9d80-283a51335d2a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:36.264040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5956556f-3c67-4203-9d80-283a51335d2a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:36.270768 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5956556f-3c67-4203-9d80-283a51335d2a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:36.271247 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5956556f-3c67-4203-9d80-283a51335d2a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:36.271671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5956556f-3c67-4203-9d80-283a51335d2a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:36.272374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5956556f-3c67-4203-9d80-283a51335d2a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:36.272820 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5956556f-3c67-4203-9d80-283a51335d2a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:36.273235 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5956556f-3c67-4203-9d80-283a51335d2a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:36.405752 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5956556f-3c67-4203-9d80-283a51335d2a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:36.413389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5956556f-3c67-4203-9d80-283a51335d2a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.153721 Aug 30 01:59:36.413944 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 269/519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:36 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:36.777343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:36.777939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:36.784233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:36.784760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:36.785177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:36.785869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:36.786326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:36.786744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:36.916222 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:36.924462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:36.925976 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:36.927170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2499924b-4f41-458e-ae95-c21bb292ae09 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.153918 Aug 30 01:59:36.927806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 270/520] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:36 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:37.434510 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-933e0d7c-13d8-4f33-83b6-c2dab805acb4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:37.435105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-933e0d7c-13d8-4f33-83b6-c2dab805acb4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:37.441463 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-933e0d7c-13d8-4f33-83b6-c2dab805acb4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:37.441933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-933e0d7c-13d8-4f33-83b6-c2dab805acb4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:37.442360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-933e0d7c-13d8-4f33-83b6-c2dab805acb4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:37.443033 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-933e0d7c-13d8-4f33-83b6-c2dab805acb4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:37.443477 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-933e0d7c-13d8-4f33-83b6-c2dab805acb4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:37.443895 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-933e0d7c-13d8-4f33-83b6-c2dab805acb4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:37.571079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-933e0d7c-13d8-4f33-83b6-c2dab805acb4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:37.578563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-933e0d7c-13d8-4f33-83b6-c2dab805acb4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.148455 Aug 30 01:59:37.579116 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 271/521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:37 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:37.951636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:37.952285 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:37.962278 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:37.962760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:37.963177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:37.963861 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:37.964340 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:37.964773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:38.092459 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:38.100684 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:38.102169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:38.103807 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6cec2181-a1a1-40d7-aac8-78c0d1814471 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.156638 Aug 30 01:59:38.104630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 272/522] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:37 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:38.601143 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c4b303a2-efca-48b8-8a95-bc604b5b5cc9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:38.602102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c4b303a2-efca-48b8-8a95-bc604b5b5cc9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:38.610018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4b303a2-efca-48b8-8a95-bc604b5b5cc9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:38.610916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4b303a2-efca-48b8-8a95-bc604b5b5cc9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:38.611355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4b303a2-efca-48b8-8a95-bc604b5b5cc9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:38.612088 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4b303a2-efca-48b8-8a95-bc604b5b5cc9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:38.612566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4b303a2-efca-48b8-8a95-bc604b5b5cc9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:38.612984 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c4b303a2-efca-48b8-8a95-bc604b5b5cc9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:38.747192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c4b303a2-efca-48b8-8a95-bc604b5b5cc9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:38.755189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c4b303a2-efca-48b8-8a95-bc604b5b5cc9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.158331 Aug 30 01:59:38.755746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 273/523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:38 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:39.127025 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:39.127625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:39.133809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:39.134287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:39.134765 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:39.135425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:39.135878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:39.136331 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:39.264538 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:39.272406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:39.273849 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:39.275489 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e6966543-a5a3-4a80-9f70-57c1707b8c05 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.152386 Aug 30 01:59:39.276040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 274/524] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:39 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:39.776277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6ccac166-40a5-4e90-b677-8e3f7df4b6c0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:39.776897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6ccac166-40a5-4e90-b677-8e3f7df4b6c0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:39.783308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6ccac166-40a5-4e90-b677-8e3f7df4b6c0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:39.783733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6ccac166-40a5-4e90-b677-8e3f7df4b6c0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:39.784168 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6ccac166-40a5-4e90-b677-8e3f7df4b6c0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:39.784879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6ccac166-40a5-4e90-b677-8e3f7df4b6c0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:39.785333 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6ccac166-40a5-4e90-b677-8e3f7df4b6c0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:39.785756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6ccac166-40a5-4e90-b677-8e3f7df4b6c0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:39.914144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6ccac166-40a5-4e90-b677-8e3f7df4b6c0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:39.921825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6ccac166-40a5-4e90-b677-8e3f7df4b6c0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.149984 Aug 30 01:59:39.922370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 275/525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:39 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:40.298063 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:40.298698 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:40.304739 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:40.305780 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:40.306219 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:40.306909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:40.307362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:40.307787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:40.435714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:40.443627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:40.445122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:40.446269 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-46a68d2f-102b-406c-afe5-d4036b58dac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.152122 Aug 30 01:59:40.446825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 276/526] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:40 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:40.942768 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1c44fc56-43d6-4347-821e-39018924cbd7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:40.943370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1c44fc56-43d6-4347-821e-39018924cbd7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:40.950624 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c44fc56-43d6-4347-821e-39018924cbd7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:40.951109 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c44fc56-43d6-4347-821e-39018924cbd7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:40.951536 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c44fc56-43d6-4347-821e-39018924cbd7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:40.952223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c44fc56-43d6-4347-821e-39018924cbd7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:40.952689 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c44fc56-43d6-4347-821e-39018924cbd7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:40.953108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c44fc56-43d6-4347-821e-39018924cbd7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:41.079787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1c44fc56-43d6-4347-821e-39018924cbd7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:41.087271 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1c44fc56-43d6-4347-821e-39018924cbd7 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.148341 Aug 30 01:59:41.087860 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 277/527] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:40 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:41.468542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:41.469270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:41.475100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:41.475578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:41.476006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:41.476702 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:41.477182 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:41.478132 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:41.606850 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:41.614900 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:41.616453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:41.617642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2d2a4e78-8de9-475e-be5b-2ac8deea08c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.153197 Aug 30 01:59:41.618185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 278/528] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:41 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:41.747916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=9 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:41.824570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=15 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:42.107397 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6960c69b-5612-46da-af7c-1ded2a02cae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:42.107883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6960c69b-5612-46da-af7c-1ded2a02cae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:42.114350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6960c69b-5612-46da-af7c-1ded2a02cae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:42.114824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6960c69b-5612-46da-af7c-1ded2a02cae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:42.115249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6960c69b-5612-46da-af7c-1ded2a02cae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:42.115922 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6960c69b-5612-46da-af7c-1ded2a02cae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:42.116399 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6960c69b-5612-46da-af7c-1ded2a02cae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:42.116817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6960c69b-5612-46da-af7c-1ded2a02cae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:42.242641 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6960c69b-5612-46da-af7c-1ded2a02cae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:42.250631 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6960c69b-5612-46da-af7c-1ded2a02cae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.147351 Aug 30 01:59:42.251188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 279/529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:42 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:42.641731 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:42.642611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:42.648582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:42.648994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:42.649423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:42.650101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:42.650546 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:42.650956 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:42.779508 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:42.787350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:42.788800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:42.789933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-74d4b106-5fe6-4f90-ad02-ff1fb6cc7d4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.153039 Aug 30 01:59:42.790964 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 280/530] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:42 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:43.277290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e701af5a-d823-4e82-894f-be625395f818 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:43.277897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e701af5a-d823-4e82-894f-be625395f818 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:43.284254 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e701af5a-d823-4e82-894f-be625395f818 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:43.284747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e701af5a-d823-4e82-894f-be625395f818 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:43.285178 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e701af5a-d823-4e82-894f-be625395f818 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:43.285867 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e701af5a-d823-4e82-894f-be625395f818 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:43.286319 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e701af5a-d823-4e82-894f-be625395f818 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:43.286745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e701af5a-d823-4e82-894f-be625395f818 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:43.417112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e701af5a-d823-4e82-894f-be625395f818 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:43.424723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e701af5a-d823-4e82-894f-be625395f818 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.151711 Aug 30 01:59:43.425285 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 281/531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:43 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:43.812962 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:43.813586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:43.819555 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:43.819912 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:43.820448 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:43.821137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:43.821588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:43.822601 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:43.837096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:43.949279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:43.961685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:43.965442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:43.967843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d5c9535c-6420-4879-8860-b2e35bd49441 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.158309 Aug 30 01:59:43.969160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 282/532] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:43 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:59:44.444714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c65b8d7e-173e-4968-a1b2-361ff19dc51c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:44.445329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c65b8d7e-173e-4968-a1b2-361ff19dc51c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:44.451713 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c65b8d7e-173e-4968-a1b2-361ff19dc51c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:44.452194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c65b8d7e-173e-4968-a1b2-361ff19dc51c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:44.452665 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c65b8d7e-173e-4968-a1b2-361ff19dc51c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:44.453350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c65b8d7e-173e-4968-a1b2-361ff19dc51c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:44.453805 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c65b8d7e-173e-4968-a1b2-361ff19dc51c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:44.454231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c65b8d7e-173e-4968-a1b2-361ff19dc51c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:44.586124 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c65b8d7e-173e-4968-a1b2-361ff19dc51c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:44.594196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c65b8d7e-173e-4968-a1b2-361ff19dc51c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.153273 Aug 30 01:59:44.594762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 283/533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:44 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:44.729916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2c873bb2-b8f2-4b72-95d3-ded3f074d27a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.994016 Aug 30 01:59:44.730511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 251/534] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 01:59:31 2022] POST /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/os-volume_attachments => generated 194 bytes in 12996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:59:44.992730 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:44.993335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:44.999167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:44.999645 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:45.000079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:45.000812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:45.001267 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:45.001685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:45.208378 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:45.216719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:45.218157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:45.219376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9462b812-7f2d-42de-a350-fe12267972d5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.230595 Aug 30 01:59:45.229164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 284/535] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:44 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:45.615843 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5bdb2f56-bc91-4a53-8e0c-8e0c4730681f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:45.616567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5bdb2f56-bc91-4a53-8e0c-8e0c4730681f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:45.623309 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5bdb2f56-bc91-4a53-8e0c-8e0c4730681f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:45.623783 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5bdb2f56-bc91-4a53-8e0c-8e0c4730681f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:45.624209 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5bdb2f56-bc91-4a53-8e0c-8e0c4730681f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:45.624941 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5bdb2f56-bc91-4a53-8e0c-8e0c4730681f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:45.625373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5bdb2f56-bc91-4a53-8e0c-8e0c4730681f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:45.625790 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5bdb2f56-bc91-4a53-8e0c-8e0c4730681f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:45.756648 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5bdb2f56-bc91-4a53-8e0c-8e0c4730681f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:45.764216 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5bdb2f56-bc91-4a53-8e0c-8e0c4730681f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.153009 Aug 30 01:59:45.764792 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 252/536] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:45 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:45.956575 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-99e32295-50d5-4437-afc1-020f223e815f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:45.957065 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-99e32295-50d5-4437-afc1-020f223e815f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:45.964670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99e32295-50d5-4437-afc1-020f223e815f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:45.965166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99e32295-50d5-4437-afc1-020f223e815f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:45.965599 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99e32295-50d5-4437-afc1-020f223e815f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:45.966286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99e32295-50d5-4437-afc1-020f223e815f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:45.966734 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99e32295-50d5-4437-afc1-020f223e815f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:45.967153 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-99e32295-50d5-4437-afc1-020f223e815f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:46.100737 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-99e32295-50d5-4437-afc1-020f223e815f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lazy-loading 'services' on Instance uuid e33e0127-93b8-4cdb-913a-5863f403890e {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:59:46.231617 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-99e32295-50d5-4437-afc1-020f223e815f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e/os-volume_attachments/8018ded9-9871-4a0e-a7e4-653bf673cb4e" status: 202 len: 0 microversion: 2.1 time: 0.278680 Aug 30 01:59:46.232390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 285/537] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 01:59:45 2022] DELETE /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e/os-volume_attachments/8018ded9-9871-4a0e-a7e4-653bf673cb4e => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:59:46.253817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:46.254857 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:46.271149 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:46.284451 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:46.285161 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:46.286293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:46.287525 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:46.288677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:46.450944 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:46.459050 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:46.460822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:46.462049 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-516271b2-7c26-446c-bbdc-4bc429ca81ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1742 microversion: 2.20 time: 0.222906 Aug 30 01:59:46.462675 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 253/538] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:46 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1742 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:46.785688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-086ed0ae-c2b9-4bdb-ad4d-6723fe28fc57 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:46.786377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-086ed0ae-c2b9-4bdb-ad4d-6723fe28fc57 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:46.793193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-086ed0ae-c2b9-4bdb-ad4d-6723fe28fc57 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:46.793666 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-086ed0ae-c2b9-4bdb-ad4d-6723fe28fc57 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:46.794091 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-086ed0ae-c2b9-4bdb-ad4d-6723fe28fc57 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:46.794766 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-086ed0ae-c2b9-4bdb-ad4d-6723fe28fc57 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:46.795210 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-086ed0ae-c2b9-4bdb-ad4d-6723fe28fc57 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:46.795628 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-086ed0ae-c2b9-4bdb-ad4d-6723fe28fc57 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:46.923777 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-086ed0ae-c2b9-4bdb-ad4d-6723fe28fc57 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:46.931387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-086ed0ae-c2b9-4bdb-ad4d-6723fe28fc57 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.150082 Aug 30 01:59:46.931934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 286/539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:46 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:47.484155 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:47.484881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:47.491303 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:47.491782 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:47.492231 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:47.492939 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:47.493391 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:47.494359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:47.632847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:47.641953 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:47.643391 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:47.644833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e6a480e1-cfe7-43f6-9083-b401bb8ebf5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.164284 Aug 30 01:59:47.645507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 254/540] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:47 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:47.952803 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-01bfe341-3281-4b2f-a92f-1b7a51587200 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:47.954119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-01bfe341-3281-4b2f-a92f-1b7a51587200 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:47.961083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01bfe341-3281-4b2f-a92f-1b7a51587200 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:47.961616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01bfe341-3281-4b2f-a92f-1b7a51587200 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:47.962055 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01bfe341-3281-4b2f-a92f-1b7a51587200 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:47.979454 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01bfe341-3281-4b2f-a92f-1b7a51587200 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:47.980158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01bfe341-3281-4b2f-a92f-1b7a51587200 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:47.980633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01bfe341-3281-4b2f-a92f-1b7a51587200 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:48.142706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-01bfe341-3281-4b2f-a92f-1b7a51587200 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:48.151551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-01bfe341-3281-4b2f-a92f-1b7a51587200 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.202808 Aug 30 01:59:48.152135 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 287/541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:47 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:48.296891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-e2fa5cbb-cf2e-4650-a8eb-4e0638cd480e req-bf8f57d5-864a-4b05-b52c-88cf792c68cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9adad9-3583-4b2c-bb23-b55ab2c97b2c", "name": "network-vif-plugged", "status": "completed", "tag": "23743ca1-3a9e-4a05-9026-c437ca9a2dec"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:48.309112 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e2fa5cbb-cf2e-4650-a8eb-4e0638cd480e req-bf8f57d5-864a-4b05-b52c-88cf792c68cf service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:48.309775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e2fa5cbb-cf2e-4650-a8eb-4e0638cd480e req-bf8f57d5-864a-4b05-b52c-88cf792c68cf service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:48.310373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-e2fa5cbb-cf2e-4650-a8eb-4e0638cd480e req-bf8f57d5-864a-4b05-b52c-88cf792c68cf service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:48.322668 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-e2fa5cbb-cf2e-4650-a8eb-4e0638cd480e req-bf8f57d5-864a-4b05-b52c-88cf792c68cf service nova] Creating event network-vif-plugged:23743ca1-3a9e-4a05-9026-c437ca9a2dec for instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c on hv-cinder-81966 Aug 30 01:59:48.328366 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-e2fa5cbb-cf2e-4650-a8eb-4e0638cd480e req-bf8f57d5-864a-4b05-b52c-88cf792c68cf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035726 Aug 30 01:59:48.329464 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 255/542] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:59:48.668128 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:48.668859 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:48.677670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:48.681321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:48.681845 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:48.682625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:48.683364 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:48.684831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:48.826350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:48.834337 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:48.835781 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:48.837280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-06fe6472-7158-4b3b-82f0-0a4d0afa0daa tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.173124 Aug 30 01:59:48.840714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 288/543] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:48 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:49.172993 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5b5007e2-73c8-4f0b-a934-151cfdfcc553 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:49.173674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5b5007e2-73c8-4f0b-a934-151cfdfcc553 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:49.179749 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b5007e2-73c8-4f0b-a934-151cfdfcc553 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:49.180220 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b5007e2-73c8-4f0b-a934-151cfdfcc553 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:49.180676 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b5007e2-73c8-4f0b-a934-151cfdfcc553 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:49.181863 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b5007e2-73c8-4f0b-a934-151cfdfcc553 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:49.182307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b5007e2-73c8-4f0b-a934-151cfdfcc553 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:49.182757 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5b5007e2-73c8-4f0b-a934-151cfdfcc553 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:49.333191 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5b5007e2-73c8-4f0b-a934-151cfdfcc553 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:49.341254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5b5007e2-73c8-4f0b-a934-151cfdfcc553 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.172858 Aug 30 01:59:49.341823 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 256/544] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:49 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:49.863079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:49.863794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:49.870556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:49.871034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:49.871462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:49.872300 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:49.872757 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:49.873179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:50.011226 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:50.020800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:50.022351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:50.023606 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b97f6273-4e41-42d5-9e80-b3505b16f88c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.165694 Aug 30 01:59:50.024189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 289/545] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:49 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:50.364406 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3f004a40-2f80-4d03-be04-d6ff7c245f8d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:50.365014 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3f004a40-2f80-4d03-be04-d6ff7c245f8d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:50.372154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f004a40-2f80-4d03-be04-d6ff7c245f8d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:50.373604 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f004a40-2f80-4d03-be04-d6ff7c245f8d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:50.374455 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f004a40-2f80-4d03-be04-d6ff7c245f8d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:50.375654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f004a40-2f80-4d03-be04-d6ff7c245f8d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:50.376688 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f004a40-2f80-4d03-be04-d6ff7c245f8d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:50.379038 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f004a40-2f80-4d03-be04-d6ff7c245f8d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:50.522189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3f004a40-2f80-4d03-be04-d6ff7c245f8d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:50.530158 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3f004a40-2f80-4d03-be04-d6ff7c245f8d tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.170749 Aug 30 01:59:50.530927 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 257/546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:50 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:51.046955 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:51.047653 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:51.054137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:51.054610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:51.055035 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:51.055719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:51.056778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:51.057200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:51.187722 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:51.196634 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:51.198079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:51.199291 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e613674b-6f0c-4855-943c-988accbae77a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.156150 Aug 30 01:59:51.200056 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 290/547] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:51 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:51.551586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4d02ac71-db01-47d2-9a61-d097ff1b507f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:51.552873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4d02ac71-db01-47d2-9a61-d097ff1b507f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:51.559295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d02ac71-db01-47d2-9a61-d097ff1b507f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:51.559963 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d02ac71-db01-47d2-9a61-d097ff1b507f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:51.561010 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d02ac71-db01-47d2-9a61-d097ff1b507f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:51.561907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d02ac71-db01-47d2-9a61-d097ff1b507f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:51.562503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d02ac71-db01-47d2-9a61-d097ff1b507f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:51.563073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4d02ac71-db01-47d2-9a61-d097ff1b507f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:51.750671 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4d02ac71-db01-47d2-9a61-d097ff1b507f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:51.760856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4d02ac71-db01-47d2-9a61-d097ff1b507f tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1369 microversion: 2.1 time: 0.212177 Aug 30 01:59:51.761918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 258/548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:51 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1369 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:52.223520 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:52.224232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:52.231463 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:52.232013 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:52.232550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:52.233296 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:52.233809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:52.234306 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:52.378448 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:52.386760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:52.388194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:52.389363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7eeddc2c-444f-4167-b291-5d4a09c42e9a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.170340 Aug 30 01:59:52.390084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 291/549] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:52 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:52.782452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a54e4f32-491e-403a-a209-9d8bbd0587e9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:52.783065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a54e4f32-491e-403a-a209-9d8bbd0587e9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:52.790055 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54e4f32-491e-403a-a209-9d8bbd0587e9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:52.790704 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54e4f32-491e-403a-a209-9d8bbd0587e9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:52.791240 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54e4f32-491e-403a-a209-9d8bbd0587e9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:52.792642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54e4f32-491e-403a-a209-9d8bbd0587e9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:52.793514 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54e4f32-491e-403a-a209-9d8bbd0587e9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:52.794112 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54e4f32-491e-403a-a209-9d8bbd0587e9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:52.930700 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a54e4f32-491e-403a-a209-9d8bbd0587e9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:52.939870 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a54e4f32-491e-403a-a209-9d8bbd0587e9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1564 microversion: 2.1 time: 0.161824 Aug 30 01:59:52.940456 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 259/550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:52 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:52.961393 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cfc79839-2c53-4f58-8418-e542cd623b13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:52.961936 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cfc79839-2c53-4f58-8418-e542cd623b13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:52.969191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cfc79839-2c53-4f58-8418-e542cd623b13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:52.969596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cfc79839-2c53-4f58-8418-e542cd623b13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:52.970373 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cfc79839-2c53-4f58-8418-e542cd623b13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:52.971500 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cfc79839-2c53-4f58-8418-e542cd623b13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:52.972114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cfc79839-2c53-4f58-8418-e542cd623b13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:52.972560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cfc79839-2c53-4f58-8418-e542cd623b13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:53.060194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cfc79839-2c53-4f58-8418-e542cd623b13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103138 Aug 30 01:59:53.060880 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 292/551] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 01:59:52 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:59:53.414852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:53.416654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:53.422325 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:53.423555 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:53.424404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:53.425116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:53.425568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:53.425990 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:53.598263 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:53.610405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:53.611855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:53.613521 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f7dc2e37-f0dd-4d9f-8840-83d9efbabcd0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.204366 Aug 30 01:59:53.628972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 260/552] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:53 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:53.958621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bad55ae4-5cb1-4b45-825f-b2ad35fb7b1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: .version_select at 0x7f3b0816ae50>, body: {"keypair": {"name": "tempest-keypair-1064451567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTQKaE4t+z0mKVBMuZv8IqHZ4PiToHuCkeTLuYzC2kjPUvtjgysi4Awfi6QqEsjqZxB+e9ZBMFr6VCDqiTqPBSKBN/ab+gwwyP14k2E30WBgeo5M1xqU4nh3YntggkW8Q=="}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:53.969148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=92 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:59:53.980983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-bad55ae4-5cb1-4b45-825f-b2ad35fb7b1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for project b9d96d936ce8417197008a59da394df7. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:59:53.986625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-bad55ae4-5cb1-4b45-825f-b2ad35fb7b1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for user a06de37941264b979a3bd5aaf84ec73c and project b9d96d936ce8417197008a59da394df7. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:59:54.019477 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bad55ae4-5cb1-4b45-825f-b2ad35fb7b1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066075 Aug 30 01:59:54.025541 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 293/553] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 01:59:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:59:54.445859 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-b2776880-0738-48c6-983f-ed351755f403 req-35a1f149-5435-4032-aec0-e67ec90f62aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9adad9-3583-4b2c-bb23-b55ab2c97b2c", "tag": "23743ca1-3a9e-4a05-9026-c437ca9a2dec"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:54.464119 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b2776880-0738-48c6-983f-ed351755f403 req-35a1f149-5435-4032-aec0-e67ec90f62aa service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:54.472998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b2776880-0738-48c6-983f-ed351755f403 req-35a1f149-5435-4032-aec0-e67ec90f62aa service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:54.473708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-b2776880-0738-48c6-983f-ed351755f403 req-35a1f149-5435-4032-aec0-e67ec90f62aa service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:54.510580 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-b2776880-0738-48c6-983f-ed351755f403 req-35a1f149-5435-4032-aec0-e67ec90f62aa service nova] Creating event network-changed:23743ca1-3a9e-4a05-9026-c437ca9a2dec for instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c on hv-cinder-81966 Aug 30 01:59:54.519383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-b2776880-0738-48c6-983f-ed351755f403 req-35a1f149-5435-4032-aec0-e67ec90f62aa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079273 Aug 30 01:59:54.525280 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 261/554] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 01:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:59:54.637541 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:54.638147 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:54.645943 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:54.649890 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:54.652859 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:54.653782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:54.654394 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:54.656760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:55.077146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:55.090602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:55.092143 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:55.093414 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d02a7678-9cbb-4c3f-a696-00509f437083 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.459771 Aug 30 01:59:55.099571 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 294/555] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:54 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:55.841189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1061919025", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71f52012-15ba-448d-9108-20629e1d18ee"}], "security_groups": [{"name": "tempest-securitygroup--1113521855"}], "key_name": "tempest-keypair-1064451567", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:59:56.020463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] validate_networks() for [('71f52012-15ba-448d-9108-20629e1d18ee', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:59:56.121830 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:56.121830 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:56.135656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:56.138454 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:56.139083 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:56.140000 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:56.142544 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:56.143521 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:56.491719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:56.502754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:56.504761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:56.512180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-03ad8942-277c-4a6e-994e-71d0a51f2d76 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.397189 Aug 30 01:59:56.514307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 295/556] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:56 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:56.649089 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:59:56.649794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:59:56.650419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:59:56.650977 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:59:56.651587 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:59:56.663456 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:56.664305 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:56.665278 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:56.666317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:56.666922 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:56.667632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:56.689997 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for project b9d96d936ce8417197008a59da394df7. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:59:56.696163 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for user a06de37941264b979a3bd5aaf84ec73c and project b9d96d936ce8417197008a59da394df7. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:59:56.710399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:59:56.713572 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:59:56.771767 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c8fd56fe-2a99-461b-9564-56cc67a8bec8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.936125 Aug 30 01:59:56.780349 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 262/557] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 01:59:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:59:56.784316 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d5151479-c2e4-4276-a86b-fe6cc96d30f8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:56.785060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d5151479-c2e4-4276-a86b-fe6cc96d30f8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:56.852553 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d5151479-c2e4-4276-a86b-fe6cc96d30f8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:56.859822 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d5151479-c2e4-4276-a86b-fe6cc96d30f8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1242 microversion: 2.1 time: 0.079673 Aug 30 01:59:56.861689 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 296/558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:56 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:57.535744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:57.537048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:57.547870 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:57.549167 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:57.549753 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:57.550758 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:57.551377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:57.551947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:57.698522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:57.725240 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:57.727027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:57.728540 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f3df89f2-0648-4a5c-8994-de74f394ca28 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.197329 Aug 30 01:59:57.745784 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 263/559] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:57 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:57.887363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8e81a712-696a-4114-8bb2-8e2bcc503b82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:57.888563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8e81a712-696a-4114-8bb2-8e2bcc503b82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:57.905842 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8e81a712-696a-4114-8bb2-8e2bcc503b82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:57.907279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8e81a712-696a-4114-8bb2-8e2bcc503b82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:57.908102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8e81a712-696a-4114-8bb2-8e2bcc503b82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:57.909211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8e81a712-696a-4114-8bb2-8e2bcc503b82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:57.909855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8e81a712-696a-4114-8bb2-8e2bcc503b82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:57.910505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8e81a712-696a-4114-8bb2-8e2bcc503b82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:57.996345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8e81a712-696a-4114-8bb2-8e2bcc503b82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:58.008599 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8e81a712-696a-4114-8bb2-8e2bcc503b82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1294 microversion: 2.1 time: 0.131156 Aug 30 01:59:58.010199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 297/560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:57 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:59:58.751945 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:58.752723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:58.760312 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:58.764888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:58.765545 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:58.766463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:58.766992 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:58.767486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:58.918003 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:58.926474 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:58.927925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:58.929112 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d932639a-9b2f-4903-b03f-33b377c03562 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.181267 Aug 30 01:59:58.929844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 264/561] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:58 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:59:59.033224 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-25f324f9-c04b-45b3-8f87-8e9cfab9137d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:59.033998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-25f324f9-c04b-45b3-8f87-8e9cfab9137d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:59.040580 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-25f324f9-c04b-45b3-8f87-8e9cfab9137d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:59.041155 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-25f324f9-c04b-45b3-8f87-8e9cfab9137d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:59.041814 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-25f324f9-c04b-45b3-8f87-8e9cfab9137d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:59.042497 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-25f324f9-c04b-45b3-8f87-8e9cfab9137d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:59.043040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-25f324f9-c04b-45b3-8f87-8e9cfab9137d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:59.043460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-25f324f9-c04b-45b3-8f87-8e9cfab9137d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:59.108003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-25f324f9-c04b-45b3-8f87-8e9cfab9137d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:59:59.116346 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-25f324f9-c04b-45b3-8f87-8e9cfab9137d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.086871 Aug 30 01:59:59.117589 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 298/562] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 01:59:59 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:59:59.951589 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:59:59.952383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:59:59.959036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:59.959631 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:59.960317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:59:59.961230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:59:59.961880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:59:59.963081 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:00.110570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:00.118586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:00.120024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:00.123157 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3fccf1da-8e91-4aac-a414-807f583d986f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.175312 Aug 30 02:00:00.128968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 265/563] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 01:59:59 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:00.144349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fe36e061-17e7-4a7f-8c11-d64a8b9aab89 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:00.145103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-fe36e061-17e7-4a7f-8c11-d64a8b9aab89 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:00.156837 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe36e061-17e7-4a7f-8c11-d64a8b9aab89 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:00.157336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe36e061-17e7-4a7f-8c11-d64a8b9aab89 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:00.157763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe36e061-17e7-4a7f-8c11-d64a8b9aab89 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:00.158449 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe36e061-17e7-4a7f-8c11-d64a8b9aab89 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:00.158892 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe36e061-17e7-4a7f-8c11-d64a8b9aab89 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:00.159308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe36e061-17e7-4a7f-8c11-d64a8b9aab89 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:00.220656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-fe36e061-17e7-4a7f-8c11-d64a8b9aab89 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:00.228343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-fe36e061-17e7-4a7f-8c11-d64a8b9aab89 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.088378 Aug 30 02:00:00.228900 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 299/564] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:00 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:01.148799 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:01.149401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:01.156203 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:01.156707 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:01.157143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:01.157819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:01.158283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:01.158675 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:01.248384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f76cdcc0-3863-434f-b757-57807e840b34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:01.249088 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f76cdcc0-3863-434f-b757-57807e840b34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:01.255729 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f76cdcc0-3863-434f-b757-57807e840b34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:01.256308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f76cdcc0-3863-434f-b757-57807e840b34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:01.256811 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f76cdcc0-3863-434f-b757-57807e840b34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:01.257586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f76cdcc0-3863-434f-b757-57807e840b34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:01.258108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f76cdcc0-3863-434f-b757-57807e840b34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:01.258533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f76cdcc0-3863-434f-b757-57807e840b34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:01.282824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:01.299393 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:01.301524 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:01.302854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-956eaf36-b3a9-43fd-bbdc-c34a36937c45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.157926 Aug 30 02:00:01.303989 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 266/565] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:01 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:01.326262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f76cdcc0-3863-434f-b757-57807e840b34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:01.328501 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:01.335615 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f76cdcc0-3863-434f-b757-57807e840b34 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.091034 Aug 30 02:00:01.336167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 300/566] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:01 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:02.326332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:02.326969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:02.333340 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:02.333818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:02.334249 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:02.334929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:02.335378 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:02.335798 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:02.356587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-dae469c9-eca0-479b-817d-d84028b3acc0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:02.357806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-dae469c9-eca0-479b-817d-d84028b3acc0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:02.364613 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dae469c9-eca0-479b-817d-d84028b3acc0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:02.365096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dae469c9-eca0-479b-817d-d84028b3acc0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:02.365527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dae469c9-eca0-479b-817d-d84028b3acc0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:02.366216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dae469c9-eca0-479b-817d-d84028b3acc0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:02.376887 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dae469c9-eca0-479b-817d-d84028b3acc0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:02.377336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dae469c9-eca0-479b-817d-d84028b3acc0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:02.438932 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-dae469c9-eca0-479b-817d-d84028b3acc0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:02.446525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-dae469c9-eca0-479b-817d-d84028b3acc0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.094264 Aug 30 02:00:02.447081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 301/567] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:02 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:02.472200 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:02.480743 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:02.482181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:02.483321 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-40e097fb-3a67-4e23-bdc9-503ecc0e5fbb tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.160864 Aug 30 02:00:02.483868 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 267/568] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:02 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:03.467204 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-02bd2fe1-4cc8-45c4-a28a-0602b052d610 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:03.467753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-02bd2fe1-4cc8-45c4-a28a-0602b052d610 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:03.473731 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02bd2fe1-4cc8-45c4-a28a-0602b052d610 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:03.474206 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02bd2fe1-4cc8-45c4-a28a-0602b052d610 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:03.474627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02bd2fe1-4cc8-45c4-a28a-0602b052d610 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:03.475297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02bd2fe1-4cc8-45c4-a28a-0602b052d610 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:03.475742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02bd2fe1-4cc8-45c4-a28a-0602b052d610 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:03.476156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-02bd2fe1-4cc8-45c4-a28a-0602b052d610 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:03.506118 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:03.506857 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:03.513381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:03.513937 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:03.514455 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:03.515146 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:03.515598 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:03.516023 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:03.536688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-02bd2fe1-4cc8-45c4-a28a-0602b052d610 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:03.544798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-02bd2fe1-4cc8-45c4-a28a-0602b052d610 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.081392 Aug 30 02:00:03.545357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 302/569] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:03 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:03.640495 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:03.648502 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:03.650617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:03.651759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5ecda2a3-125a-4e93-a464-392f107da3d2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.149741 Aug 30 02:00:03.652327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 268/570] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:03 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:04.566138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-47ca3a54-a355-47d6-be52-5ddb3064c869 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:04.566811 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-47ca3a54-a355-47d6-be52-5ddb3064c869 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:04.573684 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47ca3a54-a355-47d6-be52-5ddb3064c869 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:04.574260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47ca3a54-a355-47d6-be52-5ddb3064c869 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:04.574689 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47ca3a54-a355-47d6-be52-5ddb3064c869 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:04.575368 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47ca3a54-a355-47d6-be52-5ddb3064c869 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:04.575814 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47ca3a54-a355-47d6-be52-5ddb3064c869 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:04.576310 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47ca3a54-a355-47d6-be52-5ddb3064c869 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:04.637192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-47ca3a54-a355-47d6-be52-5ddb3064c869 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:04.645125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-47ca3a54-a355-47d6-be52-5ddb3064c869 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.083123 Aug 30 02:00:04.645683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 303/571] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:04 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:04.674183 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:04.674778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:04.681151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:04.681634 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:04.682063 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:04.682746 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:04.683196 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:04.683615 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:04.687675 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:04.813734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:04.821913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:04.823447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:04.824626 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-41caef07-a2e8-4b62-81e2-f41d6c1bd4c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.154238 Aug 30 02:00:04.825172 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 269/572] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:04 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:05.665615 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b6d37ed8-ba34-4c26-9abd-7cc1824f4b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:05.666244 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b6d37ed8-ba34-4c26-9abd-7cc1824f4b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:05.672716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b6d37ed8-ba34-4c26-9abd-7cc1824f4b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:05.673191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b6d37ed8-ba34-4c26-9abd-7cc1824f4b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:05.673614 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b6d37ed8-ba34-4c26-9abd-7cc1824f4b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:05.674292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b6d37ed8-ba34-4c26-9abd-7cc1824f4b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:05.674734 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b6d37ed8-ba34-4c26-9abd-7cc1824f4b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:05.675150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b6d37ed8-ba34-4c26-9abd-7cc1824f4b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:05.746078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b6d37ed8-ba34-4c26-9abd-7cc1824f4b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:05.753669 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b6d37ed8-ba34-4c26-9abd-7cc1824f4b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.092080 Aug 30 02:00:05.754239 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 304/573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:05 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:05.857342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:05.857941 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:05.864266 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:05.864743 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:05.865169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:05.865844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:05.866290 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:05.866704 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:05.996862 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:06.004973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:06.006398 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:06.007667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d57b48c5-8d53-4715-8c00-78ce77066971 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.154653 Aug 30 02:00:06.008334 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 270/574] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:05 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:06.775913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ff26e577-e6e4-48a8-bc5f-9487b5ea4476 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:06.776685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ff26e577-e6e4-48a8-bc5f-9487b5ea4476 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:06.782993 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ff26e577-e6e4-48a8-bc5f-9487b5ea4476 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:06.783661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ff26e577-e6e4-48a8-bc5f-9487b5ea4476 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:06.784163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ff26e577-e6e4-48a8-bc5f-9487b5ea4476 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:06.785028 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ff26e577-e6e4-48a8-bc5f-9487b5ea4476 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:06.785530 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ff26e577-e6e4-48a8-bc5f-9487b5ea4476 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:06.786017 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ff26e577-e6e4-48a8-bc5f-9487b5ea4476 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:06.854600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ff26e577-e6e4-48a8-bc5f-9487b5ea4476 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:06.856772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=6 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:06.863473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ff26e577-e6e4-48a8-bc5f-9487b5ea4476 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.092435 Aug 30 02:00:06.864031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 305/575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:06 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:07.030689 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:07.031300 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:07.033180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:07.033822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:07.039994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:07.040518 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:07.040940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:07.041656 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:07.042108 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:07.042529 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:07.170715 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:07.179343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:07.181470 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:07.182756 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-05e51312-084b-49aa-81ac-ccf05293de77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.155984 Aug 30 02:00:07.183387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 271/576] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:07 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:07.883441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d12de432-16f5-4532-a01f-a5c42996a80e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:07.884069 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d12de432-16f5-4532-a01f-a5c42996a80e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:07.890554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d12de432-16f5-4532-a01f-a5c42996a80e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:07.891034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d12de432-16f5-4532-a01f-a5c42996a80e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:07.891474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d12de432-16f5-4532-a01f-a5c42996a80e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:07.892159 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d12de432-16f5-4532-a01f-a5c42996a80e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:07.892638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d12de432-16f5-4532-a01f-a5c42996a80e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:07.893062 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d12de432-16f5-4532-a01f-a5c42996a80e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:07.954863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d12de432-16f5-4532-a01f-a5c42996a80e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:07.963574 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d12de432-16f5-4532-a01f-a5c42996a80e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.084144 Aug 30 02:00:07.964142 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 306/577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:07 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:08.206471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:08.207297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:08.214730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:08.215399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:08.216047 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:08.216800 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:08.217219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:08.217643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:08.413417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:08.422232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:08.423756 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:08.425006 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-31628ce3-e57e-4239-890d-d175db24b2ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.222544 Aug 30 02:00:08.425507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 272/578] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:08 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:08.985916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-71cd07fc-8b2f-41e6-b85d-0e45302d827a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:08.989269 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-71cd07fc-8b2f-41e6-b85d-0e45302d827a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:08.993120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71cd07fc-8b2f-41e6-b85d-0e45302d827a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:08.994254 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71cd07fc-8b2f-41e6-b85d-0e45302d827a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:08.994690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71cd07fc-8b2f-41e6-b85d-0e45302d827a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:08.995421 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71cd07fc-8b2f-41e6-b85d-0e45302d827a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:08.996093 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71cd07fc-8b2f-41e6-b85d-0e45302d827a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:08.996543 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71cd07fc-8b2f-41e6-b85d-0e45302d827a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:09.060015 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-71cd07fc-8b2f-41e6-b85d-0e45302d827a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:09.068491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-71cd07fc-8b2f-41e6-b85d-0e45302d827a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.086264 Aug 30 02:00:09.069052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 307/579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:08 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:09.449168 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:09.449903 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:09.457092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:09.457752 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:09.458342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:09.459229 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:09.459978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:09.460692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:09.595580 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:09.604032 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:09.605524 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:09.606669 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-461c40f4-78c7-494d-8211-90fc824065b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.161592 Aug 30 02:00:09.607247 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 273/580] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:09 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:10.089273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5850a293-9e52-4bde-83d3-2a1c6d34d686 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:10.090300 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5850a293-9e52-4bde-83d3-2a1c6d34d686 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:10.096562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5850a293-9e52-4bde-83d3-2a1c6d34d686 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:10.097046 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5850a293-9e52-4bde-83d3-2a1c6d34d686 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:10.097476 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5850a293-9e52-4bde-83d3-2a1c6d34d686 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:10.098185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5850a293-9e52-4bde-83d3-2a1c6d34d686 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:10.098625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5850a293-9e52-4bde-83d3-2a1c6d34d686 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:10.099041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5850a293-9e52-4bde-83d3-2a1c6d34d686 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:10.165751 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5850a293-9e52-4bde-83d3-2a1c6d34d686 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:10.173697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5850a293-9e52-4bde-83d3-2a1c6d34d686 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.088558 Aug 30 02:00:10.174260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 308/581] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:10 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:10.631168 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:10.631803 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:10.637894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:10.638366 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:10.638791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:10.639489 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:10.639914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:10.640355 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:10.771686 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:10.780570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:10.782275 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:10.783386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-be80fec6-4b6b-4411-a0be-802adc45ebbe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.156420 Aug 30 02:00:10.783937 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 274/582] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:10 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:11.194401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-19a1f1f5-7295-4a87-82f4-e4215e1338e5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:11.194934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-19a1f1f5-7295-4a87-82f4-e4215e1338e5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:11.201428 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-19a1f1f5-7295-4a87-82f4-e4215e1338e5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:11.201899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-19a1f1f5-7295-4a87-82f4-e4215e1338e5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:11.202331 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-19a1f1f5-7295-4a87-82f4-e4215e1338e5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:11.203010 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-19a1f1f5-7295-4a87-82f4-e4215e1338e5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:11.203482 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-19a1f1f5-7295-4a87-82f4-e4215e1338e5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:11.203902 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-19a1f1f5-7295-4a87-82f4-e4215e1338e5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:11.263538 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-19a1f1f5-7295-4a87-82f4-e4215e1338e5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:11.270875 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-19a1f1f5-7295-4a87-82f4-e4215e1338e5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.080772 Aug 30 02:00:11.271426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 309/583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:11 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:11.806687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:11.807293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:11.809624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:11.815169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:11.815638 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:11.816062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:11.816768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:11.817213 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:11.817625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:11.959075 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:11.968675 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:11.970131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:11.971339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f899d23f-7968-40a5-ada8-c9401e169f80 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.169216 Aug 30 02:00:11.972139 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 275/584] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:11 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:12.290764 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-370aa0c4-a138-4a43-90f4-d89d3bff2ac5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:12.291371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-370aa0c4-a138-4a43-90f4-d89d3bff2ac5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:12.297773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-370aa0c4-a138-4a43-90f4-d89d3bff2ac5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:12.298719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-370aa0c4-a138-4a43-90f4-d89d3bff2ac5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:12.298719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-370aa0c4-a138-4a43-90f4-d89d3bff2ac5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:12.299335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-370aa0c4-a138-4a43-90f4-d89d3bff2ac5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:12.299793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-370aa0c4-a138-4a43-90f4-d89d3bff2ac5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:12.300266 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-370aa0c4-a138-4a43-90f4-d89d3bff2ac5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:12.359393 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-370aa0c4-a138-4a43-90f4-d89d3bff2ac5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:12.366756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-370aa0c4-a138-4a43-90f4-d89d3bff2ac5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.079849 Aug 30 02:00:12.367312 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 310/585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:12 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:12.993050 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:12.993652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:12.999980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:13.000489 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:13.000918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:13.001611 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:13.002033 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:13.002448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:13.125564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:13.133641 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:13.135060 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:13.136195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4a0ef8b4-7a64-4f2f-b8ec-1e329d3bba68 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.146950 Aug 30 02:00:13.136766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 276/586] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:12 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:13.388505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6f3c8398-30b6-4f30-82c6-55eccba157f1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:13.389118 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6f3c8398-30b6-4f30-82c6-55eccba157f1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:13.395422 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6f3c8398-30b6-4f30-82c6-55eccba157f1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:13.395904 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6f3c8398-30b6-4f30-82c6-55eccba157f1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:13.396359 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6f3c8398-30b6-4f30-82c6-55eccba157f1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:13.397044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6f3c8398-30b6-4f30-82c6-55eccba157f1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:13.397496 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6f3c8398-30b6-4f30-82c6-55eccba157f1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:13.397919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6f3c8398-30b6-4f30-82c6-55eccba157f1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:13.457210 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6f3c8398-30b6-4f30-82c6-55eccba157f1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:13.465322 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6f3c8398-30b6-4f30-82c6-55eccba157f1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.081222 Aug 30 02:00:13.465872 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 311/587] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:13 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:14.158775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:14.159377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:14.166155 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:14.166626 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:14.167052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:14.167729 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:14.168175 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:14.168621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:14.295371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:14.303390 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:14.304856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:14.306671 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-436ab74c-67a2-4d2b-a99b-2258571f3156 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.151092 Aug 30 02:00:14.307219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 277/588] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:14 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:14.485495 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-797ea0e5-6723-41e1-8943-7d774571f920 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:14.486106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-797ea0e5-6723-41e1-8943-7d774571f920 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:14.492581 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-797ea0e5-6723-41e1-8943-7d774571f920 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:14.493063 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-797ea0e5-6723-41e1-8943-7d774571f920 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:14.493514 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-797ea0e5-6723-41e1-8943-7d774571f920 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:14.494189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-797ea0e5-6723-41e1-8943-7d774571f920 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:14.494638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-797ea0e5-6723-41e1-8943-7d774571f920 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:14.495057 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-797ea0e5-6723-41e1-8943-7d774571f920 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:14.557818 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-797ea0e5-6723-41e1-8943-7d774571f920 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:14.565508 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-797ea0e5-6723-41e1-8943-7d774571f920 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.083852 Aug 30 02:00:14.566071 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 312/589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:14 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:15.329052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:15.329658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:15.335992 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:15.336506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:15.336972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:15.337653 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:15.338098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:15.338519 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:15.463491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:15.471314 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:15.472771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:15.473906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-18a5c9ee-15bc-422f-91a9-7a8abe1a1649 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.148843 Aug 30 02:00:15.474449 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 278/590] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:15 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:15.585617 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4717a495-1790-4246-8625-3f289767953c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:15.586226 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4717a495-1790-4246-8625-3f289767953c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:15.592646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4717a495-1790-4246-8625-3f289767953c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:15.593120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4717a495-1790-4246-8625-3f289767953c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:15.593552 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4717a495-1790-4246-8625-3f289767953c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:15.594229 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4717a495-1790-4246-8625-3f289767953c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:15.594677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4717a495-1790-4246-8625-3f289767953c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:15.595097 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4717a495-1790-4246-8625-3f289767953c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:15.657018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4717a495-1790-4246-8625-3f289767953c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:15.664432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4717a495-1790-4246-8625-3f289767953c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.082585 Aug 30 02:00:15.665523 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 313/591] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:15 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:16.496536 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:16.497138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:16.504053 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:16.504563 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:16.505241 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:16.505914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:16.506358 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:16.506795 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:16.629660 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:16.638397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:16.639821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:16.640981 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1ca46e13-ce44-42de-ab9c-3e0cf0ba2edc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.148375 Aug 30 02:00:16.641521 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 279/592] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:16 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:16.685158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3a1dd805-b549-4406-b5ff-eab0acf1b68e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:16.685767 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3a1dd805-b549-4406-b5ff-eab0acf1b68e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:16.691693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a1dd805-b549-4406-b5ff-eab0acf1b68e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:16.692731 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a1dd805-b549-4406-b5ff-eab0acf1b68e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:16.693163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a1dd805-b549-4406-b5ff-eab0acf1b68e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:16.693844 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a1dd805-b549-4406-b5ff-eab0acf1b68e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:16.694288 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a1dd805-b549-4406-b5ff-eab0acf1b68e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:16.694706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a1dd805-b549-4406-b5ff-eab0acf1b68e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:16.757407 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3a1dd805-b549-4406-b5ff-eab0acf1b68e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:16.765516 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3a1dd805-b549-4406-b5ff-eab0acf1b68e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.084707 Aug 30 02:00:16.766064 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 314/593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:16 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:17.663876 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:17.664511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:17.671606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:17.672079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:17.672540 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:17.673217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:17.673665 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:17.674083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:17.785410 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3cc35ccd-eb3c-42ba-9df7-f2368fc66d0f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:17.786018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3cc35ccd-eb3c-42ba-9df7-f2368fc66d0f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:17.793107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cc35ccd-eb3c-42ba-9df7-f2368fc66d0f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:17.793583 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cc35ccd-eb3c-42ba-9df7-f2368fc66d0f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:17.794015 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cc35ccd-eb3c-42ba-9df7-f2368fc66d0f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:17.794692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cc35ccd-eb3c-42ba-9df7-f2368fc66d0f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:17.795138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cc35ccd-eb3c-42ba-9df7-f2368fc66d0f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:17.795551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3cc35ccd-eb3c-42ba-9df7-f2368fc66d0f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:17.803621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:17.811566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:17.813035 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:17.814193 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b00cff94-9307-47f8-b783-24ddcc9e530f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.154101 Aug 30 02:00:17.814742 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 280/594] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:17 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:17.855244 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3cc35ccd-eb3c-42ba-9df7-f2368fc66d0f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:17.862751 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3cc35ccd-eb3c-42ba-9df7-f2368fc66d0f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.081144 Aug 30 02:00:17.863305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 315/595] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:17 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:18.836351 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:18.837020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:18.843303 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:18.843784 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:18.844217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:18.844961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:18.845414 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:18.845835 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:18.883229 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-781271c5-c752-4866-bbc9-b5fdbea2c330 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:18.883933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-781271c5-c752-4866-bbc9-b5fdbea2c330 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:18.890563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-781271c5-c752-4866-bbc9-b5fdbea2c330 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:18.891051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-781271c5-c752-4866-bbc9-b5fdbea2c330 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:18.891483 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-781271c5-c752-4866-bbc9-b5fdbea2c330 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:18.892175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-781271c5-c752-4866-bbc9-b5fdbea2c330 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:18.892672 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-781271c5-c752-4866-bbc9-b5fdbea2c330 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:18.893100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-781271c5-c752-4866-bbc9-b5fdbea2c330 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:18.957672 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-781271c5-c752-4866-bbc9-b5fdbea2c330 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:18.965902 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-781271c5-c752-4866-bbc9-b5fdbea2c330 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.086899 Aug 30 02:00:18.966471 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 316/596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:18 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:18.971923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:18.980913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:18.982421 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:18.983581 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3e209f7d-095f-4c58-a3b2-38e716011f77 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.151160 Aug 30 02:00:18.984123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 281/597] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:18 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:19.987154 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fe9ea51a-4a4c-4b76-8476-40a1fb075727 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:19.987879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-fe9ea51a-4a4c-4b76-8476-40a1fb075727 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:19.994835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe9ea51a-4a4c-4b76-8476-40a1fb075727 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:19.995316 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe9ea51a-4a4c-4b76-8476-40a1fb075727 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:19.995751 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe9ea51a-4a4c-4b76-8476-40a1fb075727 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:19.996474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe9ea51a-4a4c-4b76-8476-40a1fb075727 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:19.996931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe9ea51a-4a4c-4b76-8476-40a1fb075727 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:19.997358 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fe9ea51a-4a4c-4b76-8476-40a1fb075727 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:20.006663 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:20.007264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:20.013652 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:20.015089 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:20.015751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:20.016438 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:20.017483 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:20.018180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:20.018806 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:20.060714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-fe9ea51a-4a4c-4b76-8476-40a1fb075727 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:20.068650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-fe9ea51a-4a4c-4b76-8476-40a1fb075727 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.085318 Aug 30 02:00:20.069206 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 317/598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:19 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:20.303839 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:20.315138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:20.317386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:20.319183 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3c9340c2-ff1d-43f8-85be-f297540146ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.316395 Aug 30 02:00:20.319766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 282/599] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:20 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:21.089653 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-aa1ef31e-1bd2-4112-896b-7df69d03f3b3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:21.090284 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-aa1ef31e-1bd2-4112-896b-7df69d03f3b3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:21.096686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aa1ef31e-1bd2-4112-896b-7df69d03f3b3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:21.097160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aa1ef31e-1bd2-4112-896b-7df69d03f3b3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:21.097585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aa1ef31e-1bd2-4112-896b-7df69d03f3b3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:21.098260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aa1ef31e-1bd2-4112-896b-7df69d03f3b3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:21.098705 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aa1ef31e-1bd2-4112-896b-7df69d03f3b3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:21.099126 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-aa1ef31e-1bd2-4112-896b-7df69d03f3b3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:21.159027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-aa1ef31e-1bd2-4112-896b-7df69d03f3b3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:21.166899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-aa1ef31e-1bd2-4112-896b-7df69d03f3b3 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.081623 Aug 30 02:00:21.167446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 318/600] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:21 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:21.343297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:21.343896 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:21.350314 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:21.350804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:21.351216 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:21.351887 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:21.352373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:21.353429 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:21.718810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:21.727570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:21.729560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:21.731194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e728720d-d1a5-4b5e-93e0-423acbb0c60d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.391852 Aug 30 02:00:21.731948 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 283/601] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:21 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:22.187230 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2600ab81-2cbf-4895-97f2-c44e37e7bf82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:22.187931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2600ab81-2cbf-4895-97f2-c44e37e7bf82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:22.194591 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2600ab81-2cbf-4895-97f2-c44e37e7bf82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:22.195061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2600ab81-2cbf-4895-97f2-c44e37e7bf82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:22.195494 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2600ab81-2cbf-4895-97f2-c44e37e7bf82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:22.196191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2600ab81-2cbf-4895-97f2-c44e37e7bf82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:22.196686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2600ab81-2cbf-4895-97f2-c44e37e7bf82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:22.197112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2600ab81-2cbf-4895-97f2-c44e37e7bf82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:22.345373 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2600ab81-2cbf-4895-97f2-c44e37e7bf82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:22.353669 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2600ab81-2cbf-4895-97f2-c44e37e7bf82 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1300 microversion: 2.1 time: 0.170177 Aug 30 02:00:22.354356 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 319/602] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:22 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1300 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:22.755646 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:22.756174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:22.763676 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:22.764193 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:22.764664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:22.765355 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:22.765809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:22.766228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:22.891224 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:22.899225 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:22.900697 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:22.901848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-09477cbb-ce2c-4809-a454-79337f1d06de tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.150761 Aug 30 02:00:22.902566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 284/603] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:22 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:23.374296 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7ec7bca3-a88d-4628-93a5-a2bca64c0ee5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:23.374902 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7ec7bca3-a88d-4628-93a5-a2bca64c0ee5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:23.381525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7ec7bca3-a88d-4628-93a5-a2bca64c0ee5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:23.382028 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7ec7bca3-a88d-4628-93a5-a2bca64c0ee5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:23.382432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7ec7bca3-a88d-4628-93a5-a2bca64c0ee5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:23.383113 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7ec7bca3-a88d-4628-93a5-a2bca64c0ee5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:23.384048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7ec7bca3-a88d-4628-93a5-a2bca64c0ee5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:23.384501 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7ec7bca3-a88d-4628-93a5-a2bca64c0ee5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:23.510186 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7ec7bca3-a88d-4628-93a5-a2bca64c0ee5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:23.517690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7ec7bca3-a88d-4628-93a5-a2bca64c0ee5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.147257 Aug 30 02:00:23.518253 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 320/604] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:23 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:23.924964 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:23.925491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:23.933091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:23.933570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:23.934004 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:23.934698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:23.935150 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:23.935570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:24.061718 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:24.065084 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:24.070623 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:24.072102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:24.073368 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-26d62ad1-8ae7-4aa8-b929-3c7e1a0e9b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.152293 Aug 30 02:00:24.073915 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 285/605] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:23 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:24.537980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-be10c3f8-6164-48ed-a872-6f472a24a49b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:24.538580 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-be10c3f8-6164-48ed-a872-6f472a24a49b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:24.541388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:24.546460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-be10c3f8-6164-48ed-a872-6f472a24a49b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:24.546930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-be10c3f8-6164-48ed-a872-6f472a24a49b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:24.547358 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-be10c3f8-6164-48ed-a872-6f472a24a49b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:24.548079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-be10c3f8-6164-48ed-a872-6f472a24a49b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:24.548503 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-be10c3f8-6164-48ed-a872-6f472a24a49b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:24.548921 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-be10c3f8-6164-48ed-a872-6f472a24a49b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:24.678478 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-be10c3f8-6164-48ed-a872-6f472a24a49b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:24.686627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-be10c3f8-6164-48ed-a872-6f472a24a49b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.152550 Aug 30 02:00:24.687170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 321/606] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:24 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:25.096470 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:25.097070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:25.104003 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:25.104528 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:25.104957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:25.105631 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:25.106073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:25.106486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:25.233190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:25.241027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:25.242444 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:25.243634 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bd170706-b8be-4f65-8ca8-333adf6dc9b0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.151609 Aug 30 02:00:25.244182 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 286/607] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:25 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:25.706673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-43edf90e-d06b-46c1-8c50-c604af66360e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:25.707284 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-43edf90e-d06b-46c1-8c50-c604af66360e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:25.713637 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-43edf90e-d06b-46c1-8c50-c604af66360e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:25.714114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-43edf90e-d06b-46c1-8c50-c604af66360e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:25.714546 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-43edf90e-d06b-46c1-8c50-c604af66360e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:25.715227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-43edf90e-d06b-46c1-8c50-c604af66360e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:25.715676 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-43edf90e-d06b-46c1-8c50-c604af66360e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:25.716098 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-43edf90e-d06b-46c1-8c50-c604af66360e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:25.841681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-43edf90e-d06b-46c1-8c50-c604af66360e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:25.849269 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-43edf90e-d06b-46c1-8c50-c604af66360e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.146406 Aug 30 02:00:25.849819 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 322/608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:25 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:26.265213 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:26.265821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:26.272173 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:26.272682 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:26.273114 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:26.273796 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:26.274246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:26.274664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:26.402280 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:26.410127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:26.411560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:26.412745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0f6532d6-2d1c-4df9-9e68-5ef04c41cf33 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.151334 Aug 30 02:00:26.413293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 287/609] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:26 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:26.868830 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c9d06551-d66b-48b1-be33-fcbf439fd688 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:26.869438 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c9d06551-d66b-48b1-be33-fcbf439fd688 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:26.875704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c9d06551-d66b-48b1-be33-fcbf439fd688 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:26.876176 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c9d06551-d66b-48b1-be33-fcbf439fd688 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:26.876636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c9d06551-d66b-48b1-be33-fcbf439fd688 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:26.877320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c9d06551-d66b-48b1-be33-fcbf439fd688 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:26.877768 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c9d06551-d66b-48b1-be33-fcbf439fd688 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:26.878187 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c9d06551-d66b-48b1-be33-fcbf439fd688 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:27.013177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c9d06551-d66b-48b1-be33-fcbf439fd688 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:27.020734 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c9d06551-d66b-48b1-be33-fcbf439fd688 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.155670 Aug 30 02:00:27.021294 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 323/610] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:26 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:27.435594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:27.436204 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:27.442592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:27.443073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:27.443504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:27.444187 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:27.444658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:27.445080 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:27.576605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:27.585004 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:27.586426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:27.588110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e4b356ab-4f57-4e36-b6e3-96b37b613aa6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1737 microversion: 2.20 time: 0.156431 Aug 30 02:00:27.588678 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 288/611] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:27 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:28.040861 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4de7fd88-48ae-4797-be46-62cd69f19246 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:28.041425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4de7fd88-48ae-4797-be46-62cd69f19246 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:28.047850 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4de7fd88-48ae-4797-be46-62cd69f19246 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:28.048543 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4de7fd88-48ae-4797-be46-62cd69f19246 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:28.048976 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4de7fd88-48ae-4797-be46-62cd69f19246 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:28.049659 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4de7fd88-48ae-4797-be46-62cd69f19246 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:28.050107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4de7fd88-48ae-4797-be46-62cd69f19246 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:28.050526 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4de7fd88-48ae-4797-be46-62cd69f19246 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:28.268554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4de7fd88-48ae-4797-be46-62cd69f19246 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:28.275998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4de7fd88-48ae-4797-be46-62cd69f19246 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.239046 Aug 30 02:00:28.276598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 324/612] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:28 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:28.421879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cfa6885-726d-4d72-b0bd-e5d702e69938 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:00:28.428060 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cfa6885-726d-4d72-b0bd-e5d702e69938 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:28.428586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cfa6885-726d-4d72-b0bd-e5d702e69938 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:28.429016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cfa6885-726d-4d72-b0bd-e5d702e69938 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:28.490360 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7cfa6885-726d-4d72-b0bd-e5d702e69938 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Going to try to stop instance {{(pid=120392) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 02:00:28.534148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-7964b271-4936-4ce8-9d7d-4bc7dea380c9 req-c816a34b-6edb-47c9-9a3b-040f0607d78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f56e8b-8c6b-469a-a47d-40fb70a05cb0", "tag": "c1a5815c-8f17-48df-ae71-427b9c4db05f"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:00:28.544277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-7964b271-4936-4ce8-9d7d-4bc7dea380c9 req-c816a34b-6edb-47c9-9a3b-040f0607d78d service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:28.544716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-7964b271-4936-4ce8-9d7d-4bc7dea380c9 req-c816a34b-6edb-47c9-9a3b-040f0607d78d service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:28.545141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-7964b271-4936-4ce8-9d7d-4bc7dea380c9 req-c816a34b-6edb-47c9-9a3b-040f0607d78d service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:28.553303 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7cfa6885-726d-4d72-b0bd-e5d702e69938 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/action" status: 202 len: 0 microversion: 2.1 time: 0.135351 Aug 30 02:00:28.554341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 289/613] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:00:28 2022] POST /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:00:28.560013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-657e03c3-61a8-417d-8c11-c6a6d5fdca7a req-abc96213-ecd6-4569-99a8-d168a4942bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51036535-5cf5-4283-b501-b0809e3f57a6", "name": "network-vif-unplugged", "status": "completed", "tag": "b76470f7-925f-4c0c-b128-d7b4fbc6e636"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:00:28.564383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-7964b271-4936-4ce8-9d7d-4bc7dea380c9 req-c816a34b-6edb-47c9-9a3b-040f0607d78d service nova] Creating event network-changed:c1a5815c-8f17-48df-ae71-427b9c4db05f for instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 on hv-cinder-81966 Aug 30 02:00:28.569540 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-7964b271-4936-4ce8-9d7d-4bc7dea380c9 req-c816a34b-6edb-47c9-9a3b-040f0607d78d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038990 Aug 30 02:00:28.569831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-657e03c3-61a8-417d-8c11-c6a6d5fdca7a req-abc96213-ecd6-4569-99a8-d168a4942bf5 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:28.570307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-657e03c3-61a8-417d-8c11-c6a6d5fdca7a req-abc96213-ecd6-4569-99a8-d168a4942bf5 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:28.570698 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 325/614] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:00:28.570822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-657e03c3-61a8-417d-8c11-c6a6d5fdca7a req-abc96213-ecd6-4569-99a8-d168a4942bf5 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:28.577973 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-274a5ec4-6ac3-4589-b0af-8790a4240b35 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:28.578910 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-274a5ec4-6ac3-4589-b0af-8790a4240b35 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:28.583506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-657e03c3-61a8-417d-8c11-c6a6d5fdca7a req-abc96213-ecd6-4569-99a8-d168a4942bf5 service nova] Creating event network-vif-unplugged:b76470f7-925f-4c0c-b128-d7b4fbc6e636 for instance 51036535-5cf5-4283-b501-b0809e3f57a6 on hv-cinder-81966 Aug 30 02:00:28.587705 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-274a5ec4-6ac3-4589-b0af-8790a4240b35 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:28.588426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-274a5ec4-6ac3-4589-b0af-8790a4240b35 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:28.588919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-274a5ec4-6ac3-4589-b0af-8790a4240b35 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:28.589058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-657e03c3-61a8-417d-8c11-c6a6d5fdca7a req-abc96213-ecd6-4569-99a8-d168a4942bf5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033169 Aug 30 02:00:28.589577 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 290/615] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:00:28.590321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-274a5ec4-6ac3-4589-b0af-8790a4240b35 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:28.590775 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-274a5ec4-6ac3-4589-b0af-8790a4240b35 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:28.591324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-274a5ec4-6ac3-4589-b0af-8790a4240b35 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:28.611903 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:28.612683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:28.619405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:28.619888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:28.620341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:28.621024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:28.621468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:28.621883 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:28.725515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-274a5ec4-6ac3-4589-b0af-8790a4240b35 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:28.733892 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-274a5ec4-6ac3-4589-b0af-8790a4240b35 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.161229 Aug 30 02:00:28.734458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 326/616] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:28 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:28.753584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:28.762558 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:28.764005 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:28.765732 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7005059e-28c9-483d-9f64-b1a6c30fb329 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.158275 Aug 30 02:00:28.765732 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 291/617] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:28 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:29.394620 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4cd5cb26-be34-46ce-b848-f91579ddb807 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:29.395255 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4cd5cb26-be34-46ce-b848-f91579ddb807 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:29.401648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4cd5cb26-be34-46ce-b848-f91579ddb807 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:29.402148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4cd5cb26-be34-46ce-b848-f91579ddb807 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:29.402575 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4cd5cb26-be34-46ce-b848-f91579ddb807 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:29.403251 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4cd5cb26-be34-46ce-b848-f91579ddb807 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:29.403697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4cd5cb26-be34-46ce-b848-f91579ddb807 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:29.404108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4cd5cb26-be34-46ce-b848-f91579ddb807 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:29.532582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4cd5cb26-be34-46ce-b848-f91579ddb807 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:29.540644 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4cd5cb26-be34-46ce-b848-f91579ddb807 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.246964 Aug 30 02:00:29.541204 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 327/618] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:29 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:29.754873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-14610588-028e-4205-9009-660dc597170d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:29.755676 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-14610588-028e-4205-9009-660dc597170d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:29.761998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14610588-028e-4205-9009-660dc597170d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:29.762479 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14610588-028e-4205-9009-660dc597170d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:29.762914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14610588-028e-4205-9009-660dc597170d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:29.763595 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14610588-028e-4205-9009-660dc597170d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:29.764047 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14610588-028e-4205-9009-660dc597170d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:29.764493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14610588-028e-4205-9009-660dc597170d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:29.787601 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:29.788205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:29.794648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:29.795127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:29.795560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:29.796266 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:29.796722 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:29.797145 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:29.891532 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-14610588-028e-4205-9009-660dc597170d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:29.901270 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-14610588-028e-4205-9009-660dc597170d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.150256 Aug 30 02:00:29.901867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 292/619] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:29 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:29.934249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:29.942344 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:29.943863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:29.945023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5ef2ee1b-de3a-4874-bda0-14844efd4fb9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.161271 Aug 30 02:00:29.945560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 328/620] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:29 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:30.561372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-25024ce2-88f0-4d48-9df5-49af69491cb6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:30.561896 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-25024ce2-88f0-4d48-9df5-49af69491cb6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:30.567801 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25024ce2-88f0-4d48-9df5-49af69491cb6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:30.568302 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25024ce2-88f0-4d48-9df5-49af69491cb6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:30.568734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25024ce2-88f0-4d48-9df5-49af69491cb6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:30.569407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25024ce2-88f0-4d48-9df5-49af69491cb6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:30.569853 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25024ce2-88f0-4d48-9df5-49af69491cb6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:30.570267 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-25024ce2-88f0-4d48-9df5-49af69491cb6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:30.694024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-25024ce2-88f0-4d48-9df5-49af69491cb6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:30.701554 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-25024ce2-88f0-4d48-9df5-49af69491cb6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.144078 Aug 30 02:00:30.702114 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 293/621] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:30 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:30.922157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-69564e41-8eb5-4370-a4ef-fda88c19c173 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:30.922696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-69564e41-8eb5-4370-a4ef-fda88c19c173 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:30.929321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69564e41-8eb5-4370-a4ef-fda88c19c173 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:30.929799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69564e41-8eb5-4370-a4ef-fda88c19c173 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:30.930233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69564e41-8eb5-4370-a4ef-fda88c19c173 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:30.930990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69564e41-8eb5-4370-a4ef-fda88c19c173 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:30.931474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69564e41-8eb5-4370-a4ef-fda88c19c173 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:30.931897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69564e41-8eb5-4370-a4ef-fda88c19c173 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:30.968501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:30.969105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:30.975613 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:30.976099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:30.976713 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:30.978051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:30.978508 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:30.978933 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:31.074967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-69564e41-8eb5-4370-a4ef-fda88c19c173 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:31.083074 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-69564e41-8eb5-4370-a4ef-fda88c19c173 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.164852 Aug 30 02:00:31.083833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 329/622] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:30 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:31.115764 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:31.123753 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:31.125199 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:31.126329 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-be7de75b-e21f-49dd-971e-0fb2e4bf5974 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.161603 Aug 30 02:00:31.126867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 294/623] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:30 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:31.722241 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b50c855f-3136-4fa5-a29f-e83fe2d6aa6b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:31.722770 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b50c855f-3136-4fa5-a29f-e83fe2d6aa6b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:31.728642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b50c855f-3136-4fa5-a29f-e83fe2d6aa6b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:31.729120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b50c855f-3136-4fa5-a29f-e83fe2d6aa6b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:31.729551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b50c855f-3136-4fa5-a29f-e83fe2d6aa6b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:31.730228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b50c855f-3136-4fa5-a29f-e83fe2d6aa6b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:31.730678 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b50c855f-3136-4fa5-a29f-e83fe2d6aa6b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:31.731096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b50c855f-3136-4fa5-a29f-e83fe2d6aa6b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:31.855569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b50c855f-3136-4fa5-a29f-e83fe2d6aa6b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:31.863052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b50c855f-3136-4fa5-a29f-e83fe2d6aa6b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.144740 Aug 30 02:00:31.863609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 330/624] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:31 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:32.105034 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-63519060-c22e-4a2a-8b20-253105d908a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:32.105650 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-63519060-c22e-4a2a-8b20-253105d908a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:32.112192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-63519060-c22e-4a2a-8b20-253105d908a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:32.112750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-63519060-c22e-4a2a-8b20-253105d908a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:32.113186 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-63519060-c22e-4a2a-8b20-253105d908a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:32.113879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-63519060-c22e-4a2a-8b20-253105d908a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:32.114332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-63519060-c22e-4a2a-8b20-253105d908a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:32.114761 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-63519060-c22e-4a2a-8b20-253105d908a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:32.148221 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:32.148969 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:32.155340 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:32.155823 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:32.156278 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:32.156996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:32.157432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:32.157853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:32.244564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-63519060-c22e-4a2a-8b20-253105d908a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:32.253099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-63519060-c22e-4a2a-8b20-253105d908a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.152447 Aug 30 02:00:32.253668 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 295/625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:32 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:32.288930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:32.297560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:32.298998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:32.300129 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3a7fe1b5-15a5-448e-906c-69153015f273 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.155838 Aug 30 02:00:32.300703 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 331/626] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:32 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:32.884559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c7cef09a-cec4-41ea-bf6e-3641ffdc6726 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:32.885165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c7cef09a-cec4-41ea-bf6e-3641ffdc6726 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:32.891133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7cef09a-cec4-41ea-bf6e-3641ffdc6726 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:32.891614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7cef09a-cec4-41ea-bf6e-3641ffdc6726 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:32.892042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7cef09a-cec4-41ea-bf6e-3641ffdc6726 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:32.892749 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7cef09a-cec4-41ea-bf6e-3641ffdc6726 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:32.893201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7cef09a-cec4-41ea-bf6e-3641ffdc6726 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:32.893621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7cef09a-cec4-41ea-bf6e-3641ffdc6726 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:33.020530 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c7cef09a-cec4-41ea-bf6e-3641ffdc6726 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:33.028519 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c7cef09a-cec4-41ea-bf6e-3641ffdc6726 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.148597 Aug 30 02:00:33.029073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 296/627] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:32 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:33.274421 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a7ecbea7-90b4-4dbc-a6cd-001880e32917 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:33.275029 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a7ecbea7-90b4-4dbc-a6cd-001880e32917 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:33.281388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7ecbea7-90b4-4dbc-a6cd-001880e32917 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:33.281874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7ecbea7-90b4-4dbc-a6cd-001880e32917 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:33.282309 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7ecbea7-90b4-4dbc-a6cd-001880e32917 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:33.283005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7ecbea7-90b4-4dbc-a6cd-001880e32917 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:33.283460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7ecbea7-90b4-4dbc-a6cd-001880e32917 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:33.283888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7ecbea7-90b4-4dbc-a6cd-001880e32917 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:33.323441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:33.324049 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:33.330425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:33.330907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:33.331337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:33.332033 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:33.332515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:33.332938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:33.411371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a7ecbea7-90b4-4dbc-a6cd-001880e32917 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:33.419634 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a7ecbea7-90b4-4dbc-a6cd-001880e32917 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.148986 Aug 30 02:00:33.420204 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 332/628] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:33 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:33.460474 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:33.468486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:33.469930 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:33.471105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1a996d44-563c-4981-9a70-4f7e3c566151 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.152160 Aug 30 02:00:33.471632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 297/629] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:33 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:34.048493 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-84baac26-5425-4258-bb1b-1e92144f4fe7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:34.049103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-84baac26-5425-4258-bb1b-1e92144f4fe7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:34.055067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84baac26-5425-4258-bb1b-1e92144f4fe7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:34.056044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84baac26-5425-4258-bb1b-1e92144f4fe7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:34.056501 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84baac26-5425-4258-bb1b-1e92144f4fe7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:34.057186 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84baac26-5425-4258-bb1b-1e92144f4fe7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:34.057636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84baac26-5425-4258-bb1b-1e92144f4fe7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:34.058055 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-84baac26-5425-4258-bb1b-1e92144f4fe7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:34.368904 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-84baac26-5425-4258-bb1b-1e92144f4fe7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:34.376630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-84baac26-5425-4258-bb1b-1e92144f4fe7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.332015 Aug 30 02:00:34.377291 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 333/630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:34 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:34.440174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ed44e2a1-581b-4867-ad57-b765d191d2ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:34.440807 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ed44e2a1-581b-4867-ad57-b765d191d2ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:34.447158 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed44e2a1-581b-4867-ad57-b765d191d2ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:34.447638 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed44e2a1-581b-4867-ad57-b765d191d2ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:34.448069 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed44e2a1-581b-4867-ad57-b765d191d2ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:34.448778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed44e2a1-581b-4867-ad57-b765d191d2ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:34.449225 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed44e2a1-581b-4867-ad57-b765d191d2ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:34.449643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed44e2a1-581b-4867-ad57-b765d191d2ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:34.494406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:34.495171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:34.501197 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:34.501618 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:34.502055 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:34.502741 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:34.503196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:34.503622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:34.576349 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ed44e2a1-581b-4867-ad57-b765d191d2ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:34.584546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ed44e2a1-581b-4867-ad57-b765d191d2ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.148151 Aug 30 02:00:34.585115 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 298/631] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:34 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:34.635406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:34.637717 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:34.645987 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:34.647419 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:34.648602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2ebe0743-4e31-44ca-806f-404d307966ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.158685 Aug 30 02:00:34.649946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 334/632] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:34 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:35.240466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3f3da832-81be-42ec-ac77-ad00ee8fc2ac tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:35.240960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3f3da832-81be-42ec-ac77-ad00ee8fc2ac tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:35.246682 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f3da832-81be-42ec-ac77-ad00ee8fc2ac tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:35.247154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f3da832-81be-42ec-ac77-ad00ee8fc2ac tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:35.247685 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f3da832-81be-42ec-ac77-ad00ee8fc2ac tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:35.248257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f3da832-81be-42ec-ac77-ad00ee8fc2ac tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:35.248787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f3da832-81be-42ec-ac77-ad00ee8fc2ac tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:35.249274 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3f3da832-81be-42ec-ac77-ad00ee8fc2ac tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:35.275188 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3f3da832-81be-42ec-ac77-ad00ee8fc2ac tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:00:35.351151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3f3da832-81be-42ec-ac77-ad00ee8fc2ac tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 204 len: 0 microversion: 2.1 time: 0.114074 Aug 30 02:00:35.351719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 299/633] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:00:35 2022] DELETE /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:00:35.360682 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-58a2521a-556a-4f7a-88c4-9e7f361108f8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:35.361404 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-58a2521a-556a-4f7a-88c4-9e7f361108f8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:35.367757 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-58a2521a-556a-4f7a-88c4-9e7f361108f8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:35.368360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-58a2521a-556a-4f7a-88c4-9e7f361108f8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:35.368858 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-58a2521a-556a-4f7a-88c4-9e7f361108f8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:35.370863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-58a2521a-556a-4f7a-88c4-9e7f361108f8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:35.371391 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-58a2521a-556a-4f7a-88c4-9e7f361108f8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:35.371856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-58a2521a-556a-4f7a-88c4-9e7f361108f8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:35.397387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5e97e29c-66d4-453f-9939-8ef13c1fd707 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:35.398082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5e97e29c-66d4-453f-9939-8ef13c1fd707 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:35.404578 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e97e29c-66d4-453f-9939-8ef13c1fd707 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:35.405261 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e97e29c-66d4-453f-9939-8ef13c1fd707 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:35.405701 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e97e29c-66d4-453f-9939-8ef13c1fd707 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:35.406386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e97e29c-66d4-453f-9939-8ef13c1fd707 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:35.406994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e97e29c-66d4-453f-9939-8ef13c1fd707 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:35.407850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e97e29c-66d4-453f-9939-8ef13c1fd707 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:35.429537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:35.523370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-58a2521a-556a-4f7a-88c4-9e7f361108f8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:35.532320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-58a2521a-556a-4f7a-88c4-9e7f361108f8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1514 microversion: 2.1 time: 0.176009 Aug 30 02:00:35.532972 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 335/634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:35 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:35.552969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5e97e29c-66d4-453f-9939-8ef13c1fd707 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:35.561158 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5e97e29c-66d4-453f-9939-8ef13c1fd707 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.167828 Aug 30 02:00:35.561709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 300/635] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:35 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:35.605801 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f4ed3080-dc98-4dd1-85fe-b8776a855bdd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:35.606413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f4ed3080-dc98-4dd1-85fe-b8776a855bdd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:35.612713 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4ed3080-dc98-4dd1-85fe-b8776a855bdd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:35.613203 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4ed3080-dc98-4dd1-85fe-b8776a855bdd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:35.613638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4ed3080-dc98-4dd1-85fe-b8776a855bdd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:35.614332 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4ed3080-dc98-4dd1-85fe-b8776a855bdd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:35.614787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4ed3080-dc98-4dd1-85fe-b8776a855bdd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:35.615212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4ed3080-dc98-4dd1-85fe-b8776a855bdd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:35.765205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f4ed3080-dc98-4dd1-85fe-b8776a855bdd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:35.774905 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f4ed3080-dc98-4dd1-85fe-b8776a855bdd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.172721 Aug 30 02:00:35.775574 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 336/636] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:35 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:35.794134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:35.794741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:35.801625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:35.802108 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:35.802540 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:35.803220 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:35.803700 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:35.804120 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:35.940896 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:35.950527 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:35.951980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:35.953217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-24cf4102-7518-40a7-a298-e8275f0ec852 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.286208 Aug 30 02:00:35.953790 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 301/637] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:35 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:36.553102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8ee6f1e5-8c3d-4015-872f-c3a42f0bcc45 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:36.553624 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8ee6f1e5-8c3d-4015-872f-c3a42f0bcc45 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:36.560638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ee6f1e5-8c3d-4015-872f-c3a42f0bcc45 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:36.561121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ee6f1e5-8c3d-4015-872f-c3a42f0bcc45 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:36.561554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ee6f1e5-8c3d-4015-872f-c3a42f0bcc45 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:36.562238 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ee6f1e5-8c3d-4015-872f-c3a42f0bcc45 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:36.562689 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ee6f1e5-8c3d-4015-872f-c3a42f0bcc45 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:36.563111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ee6f1e5-8c3d-4015-872f-c3a42f0bcc45 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:36.582084 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-019b731c-d593-4d40-a7ab-57a33f5aff46 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:36.582724 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-019b731c-d593-4d40-a7ab-57a33f5aff46 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:36.589312 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-019b731c-d593-4d40-a7ab-57a33f5aff46 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:36.589794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-019b731c-d593-4d40-a7ab-57a33f5aff46 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:36.590226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-019b731c-d593-4d40-a7ab-57a33f5aff46 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:36.590911 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-019b731c-d593-4d40-a7ab-57a33f5aff46 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:36.591392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-019b731c-d593-4d40-a7ab-57a33f5aff46 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:36.591818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-019b731c-d593-4d40-a7ab-57a33f5aff46 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:36.725987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-019b731c-d593-4d40-a7ab-57a33f5aff46 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:36.734237 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-019b731c-d593-4d40-a7ab-57a33f5aff46 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.155914 Aug 30 02:00:36.734799 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 302/638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:36 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:36.742011 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8ee6f1e5-8c3d-4015-872f-c3a42f0bcc45 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:36.752211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8ee6f1e5-8c3d-4015-872f-c3a42f0bcc45 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1514 microversion: 2.1 time: 0.202969 Aug 30 02:00:36.752957 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 337/639] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:36 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:36.796805 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-68fb5844-1f9b-458c-8c07-68d377161082 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:36.797785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-68fb5844-1f9b-458c-8c07-68d377161082 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:36.803755 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68fb5844-1f9b-458c-8c07-68d377161082 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:36.804152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68fb5844-1f9b-458c-8c07-68d377161082 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:36.804615 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68fb5844-1f9b-458c-8c07-68d377161082 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:36.806529 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68fb5844-1f9b-458c-8c07-68d377161082 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:36.806529 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68fb5844-1f9b-458c-8c07-68d377161082 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:36.806769 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-68fb5844-1f9b-458c-8c07-68d377161082 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:36.933383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-68fb5844-1f9b-458c-8c07-68d377161082 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:36.941550 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-68fb5844-1f9b-458c-8c07-68d377161082 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.148596 Aug 30 02:00:36.942108 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 303/640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:36 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:36.976674 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:36.977884 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:36.983733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:36.984207 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:36.985169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:36.985872 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:36.986309 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:36.986726 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:37.114772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:37.123096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:37.124660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:37.125879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c425f0e4-b413-47de-8eaa-401e60459548 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.153158 Aug 30 02:00:37.126502 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 338/641] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:36 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:37.754992 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c1a17eee-b70f-418c-97a0-704c68591dc8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:37.755913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c1a17eee-b70f-418c-97a0-704c68591dc8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:37.762333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1a17eee-b70f-418c-97a0-704c68591dc8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:37.762814 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1a17eee-b70f-418c-97a0-704c68591dc8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:37.763248 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1a17eee-b70f-418c-97a0-704c68591dc8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:37.763935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1a17eee-b70f-418c-97a0-704c68591dc8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:37.764419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1a17eee-b70f-418c-97a0-704c68591dc8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:37.764846 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c1a17eee-b70f-418c-97a0-704c68591dc8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:37.772821 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b9307f7b-9955-418e-90c6-4db5e126105d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:37.773430 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b9307f7b-9955-418e-90c6-4db5e126105d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:37.780194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9307f7b-9955-418e-90c6-4db5e126105d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:37.780714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9307f7b-9955-418e-90c6-4db5e126105d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:37.781147 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9307f7b-9955-418e-90c6-4db5e126105d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:37.781831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9307f7b-9955-418e-90c6-4db5e126105d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:37.782280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9307f7b-9955-418e-90c6-4db5e126105d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:37.782703 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9307f7b-9955-418e-90c6-4db5e126105d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:37.897855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c1a17eee-b70f-418c-97a0-704c68591dc8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:37.905934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c1a17eee-b70f-418c-97a0-704c68591dc8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.154759 Aug 30 02:00:37.906617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 304/642] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:37 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:37.913121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b9307f7b-9955-418e-90c6-4db5e126105d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:37.925997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b9307f7b-9955-418e-90c6-4db5e126105d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1514 microversion: 2.1 time: 0.156899 Aug 30 02:00:37.926570 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 339/643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:37 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:38.061968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b10f5683-20b0-48bb-aefa-2923cddfa0c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:38.062614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b10f5683-20b0-48bb-aefa-2923cddfa0c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:38.068558 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b10f5683-20b0-48bb-aefa-2923cddfa0c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:38.069041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b10f5683-20b0-48bb-aefa-2923cddfa0c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:38.069468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b10f5683-20b0-48bb-aefa-2923cddfa0c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:38.070147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b10f5683-20b0-48bb-aefa-2923cddfa0c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:38.070596 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b10f5683-20b0-48bb-aefa-2923cddfa0c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:38.071541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b10f5683-20b0-48bb-aefa-2923cddfa0c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:38.148617 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:38.149228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:38.155378 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:38.155928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:38.156390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:38.157077 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:38.157531 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:38.157951 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:38.202204 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b10f5683-20b0-48bb-aefa-2923cddfa0c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:38.215100 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b10f5683-20b0-48bb-aefa-2923cddfa0c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.256574 Aug 30 02:00:38.215926 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 305/644] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:37 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:38.307537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:38.315527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:38.316999 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:38.318149 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7568620e-a916-4c05-bd48-1ef1d2f83207 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.173416 Aug 30 02:00:38.318696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 340/645] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:38 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:38.927112 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-111894d5-3017-41df-9e1d-56d5401b55ac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:38.927661 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-111894d5-3017-41df-9e1d-56d5401b55ac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:38.934188 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-111894d5-3017-41df-9e1d-56d5401b55ac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:38.934666 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-111894d5-3017-41df-9e1d-56d5401b55ac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:38.935099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-111894d5-3017-41df-9e1d-56d5401b55ac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:38.935783 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-111894d5-3017-41df-9e1d-56d5401b55ac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:38.936230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-111894d5-3017-41df-9e1d-56d5401b55ac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:38.936677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-111894d5-3017-41df-9e1d-56d5401b55ac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:38.948521 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5250dce0-3059-48bb-990b-9868669eabec tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:38.949130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5250dce0-3059-48bb-990b-9868669eabec tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:38.956272 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5250dce0-3059-48bb-990b-9868669eabec tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:38.956757 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5250dce0-3059-48bb-990b-9868669eabec tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:38.957179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5250dce0-3059-48bb-990b-9868669eabec tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:38.958101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5250dce0-3059-48bb-990b-9868669eabec tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:38.958711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5250dce0-3059-48bb-990b-9868669eabec tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:38.959133 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5250dce0-3059-48bb-990b-9868669eabec tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:39.068740 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-111894d5-3017-41df-9e1d-56d5401b55ac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:39.076691 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-111894d5-3017-41df-9e1d-56d5401b55ac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.153476 Aug 30 02:00:39.077413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 306/646] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:38 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:39.092424 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5250dce0-3059-48bb-990b-9868669eabec tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:39.100071 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5250dce0-3059-48bb-990b-9868669eabec tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1514 microversion: 2.1 time: 0.155860 Aug 30 02:00:39.100650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 341/647] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:38 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:39.238151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cd715fdc-4d35-4bfd-b20a-46328b2dc6bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:39.238755 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cd715fdc-4d35-4bfd-b20a-46328b2dc6bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:39.241025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 02:00:39.241154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Tue Aug 30 02:00:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b (ip 10.222.0.50) !!! Aug 30 02:00:39.247921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd715fdc-4d35-4bfd-b20a-46328b2dc6bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:39.248432 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd715fdc-4d35-4bfd-b20a-46328b2dc6bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:39.248869 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd715fdc-4d35-4bfd-b20a-46328b2dc6bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:39.249550 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd715fdc-4d35-4bfd-b20a-46328b2dc6bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:39.249997 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd715fdc-4d35-4bfd-b20a-46328b2dc6bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:39.250413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cd715fdc-4d35-4bfd-b20a-46328b2dc6bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:39.340314 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:39.341003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:39.347360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:39.348057 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:39.348647 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:39.349406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:39.349935 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:39.350418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:39.384562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cd715fdc-4d35-4bfd-b20a-46328b2dc6bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:39.394127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cd715fdc-4d35-4bfd-b20a-46328b2dc6bf tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.159647 Aug 30 02:00:39.396326 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 307/648] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:39 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:39.490282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:39.498796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:39.500197 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:39.501359 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-50948182-b940-4cfd-a17f-a466936c5470 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.164841 Aug 30 02:00:39.501905 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 342/649] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:39 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:40.097563 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-de42234b-a09d-4c91-a608-b1d1a2867e7f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:40.098078 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-de42234b-a09d-4c91-a608-b1d1a2867e7f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:40.105168 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de42234b-a09d-4c91-a608-b1d1a2867e7f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:40.105645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de42234b-a09d-4c91-a608-b1d1a2867e7f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:40.106070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de42234b-a09d-4c91-a608-b1d1a2867e7f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:40.106757 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de42234b-a09d-4c91-a608-b1d1a2867e7f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:40.107204 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de42234b-a09d-4c91-a608-b1d1a2867e7f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:40.107621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-de42234b-a09d-4c91-a608-b1d1a2867e7f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:40.121054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6831592d-99d9-42a0-93e1-e0806b787fe0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:40.121717 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6831592d-99d9-42a0-93e1-e0806b787fe0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:40.128180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6831592d-99d9-42a0-93e1-e0806b787fe0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:40.128678 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6831592d-99d9-42a0-93e1-e0806b787fe0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:40.129103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6831592d-99d9-42a0-93e1-e0806b787fe0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:40.129777 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6831592d-99d9-42a0-93e1-e0806b787fe0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:40.130480 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6831592d-99d9-42a0-93e1-e0806b787fe0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:40.130898 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6831592d-99d9-42a0-93e1-e0806b787fe0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:40.237718 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-de42234b-a09d-4c91-a608-b1d1a2867e7f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:40.246705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-de42234b-a09d-4c91-a608-b1d1a2867e7f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.152859 Aug 30 02:00:40.247469 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 308/650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:40 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:40.265926 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6831592d-99d9-42a0-93e1-e0806b787fe0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:40.273784 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6831592d-99d9-42a0-93e1-e0806b787fe0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1514 microversion: 2.1 time: 0.156672 Aug 30 02:00:40.274909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 343/651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:40 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:40.414894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f2d62752-e36f-493b-b293-b6824dace657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:40.415422 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f2d62752-e36f-493b-b293-b6824dace657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:40.421371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2d62752-e36f-493b-b293-b6824dace657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:40.421857 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2d62752-e36f-493b-b293-b6824dace657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:40.422293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2d62752-e36f-493b-b293-b6824dace657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:40.422980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2d62752-e36f-493b-b293-b6824dace657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:40.423434 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2d62752-e36f-493b-b293-b6824dace657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:40.423867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2d62752-e36f-493b-b293-b6824dace657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:40.525674 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:40.526287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:40.532009 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:40.532555 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:40.532987 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:40.533683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:40.534130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:40.534851 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:40.562116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f2d62752-e36f-493b-b293-b6824dace657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:40.572754 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f2d62752-e36f-493b-b293-b6824dace657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.161506 Aug 30 02:00:40.573694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 309/652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:40 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:40.677496 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:40.686141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:40.687782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:40.689063 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0231c5dc-364e-4d7d-a175-f124ce5f85dc tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1719 microversion: 2.20 time: 0.167800 Aug 30 02:00:40.689698 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 344/653] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:40 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:41.266792 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7ecc1973-b568-4b2e-855e-4ea615a984ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:41.267503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7ecc1973-b568-4b2e-855e-4ea615a984ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:41.273861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ecc1973-b568-4b2e-855e-4ea615a984ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:41.274377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ecc1973-b568-4b2e-855e-4ea615a984ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:41.274809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ecc1973-b568-4b2e-855e-4ea615a984ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:41.275486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ecc1973-b568-4b2e-855e-4ea615a984ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:41.275934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ecc1973-b568-4b2e-855e-4ea615a984ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:41.276380 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ecc1973-b568-4b2e-855e-4ea615a984ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:41.297312 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9b8fa717-a827-4f34-9e63-cac739b2f9bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:41.298608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9b8fa717-a827-4f34-9e63-cac739b2f9bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:41.304691 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b8fa717-a827-4f34-9e63-cac739b2f9bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:41.305176 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b8fa717-a827-4f34-9e63-cac739b2f9bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:41.306293 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b8fa717-a827-4f34-9e63-cac739b2f9bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:41.306995 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b8fa717-a827-4f34-9e63-cac739b2f9bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:41.307446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b8fa717-a827-4f34-9e63-cac739b2f9bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:41.307869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b8fa717-a827-4f34-9e63-cac739b2f9bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:41.435414 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7ecc1973-b568-4b2e-855e-4ea615a984ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:41.443210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7ecc1973-b568-4b2e-855e-4ea615a984ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.180239 Aug 30 02:00:41.443777 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 310/654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:41 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:41.462105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9b8fa717-a827-4f34-9e63-cac739b2f9bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:41.469630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9b8fa717-a827-4f34-9e63-cac739b2f9bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1514 microversion: 2.1 time: 0.177593 Aug 30 02:00:41.470245 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 345/655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:41 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:41.595052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c6cc139b-ed71-42f1-8d3c-89958e64ca59 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:41.595694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c6cc139b-ed71-42f1-8d3c-89958e64ca59 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:41.601739 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6cc139b-ed71-42f1-8d3c-89958e64ca59 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:41.602242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6cc139b-ed71-42f1-8d3c-89958e64ca59 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:41.602709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6cc139b-ed71-42f1-8d3c-89958e64ca59 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:41.603401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6cc139b-ed71-42f1-8d3c-89958e64ca59 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:41.603852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6cc139b-ed71-42f1-8d3c-89958e64ca59 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:41.604295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6cc139b-ed71-42f1-8d3c-89958e64ca59 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:41.713985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:41.714677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:41.720671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:41.721245 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:41.721734 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:41.722506 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:41.723021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:41.723659 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:41.738096 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c6cc139b-ed71-42f1-8d3c-89958e64ca59 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:41.750777 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c6cc139b-ed71-42f1-8d3c-89958e64ca59 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.159765 Aug 30 02:00:41.751875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 311/656] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:41 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:41.855899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:41.864126 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:41.865698 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:41.866934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-790866b8-0dea-4339-9fed-c9bfadd5f0ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1722 microversion: 2.20 time: 0.156893 Aug 30 02:00:41.867485 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 346/657] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:41 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:41.889841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6567ec41-a145-4435-9ac5-ad22175cc534 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4d57fb9-994e-4479-92c3-f0989463fe42"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:00:41.892341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6567ec41-a145-4435-9ac5-ad22175cc534 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:41.894394 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:41.900481 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6567ec41-a145-4435-9ac5-ad22175cc534 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:41.900979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6567ec41-a145-4435-9ac5-ad22175cc534 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:41.901412 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6567ec41-a145-4435-9ac5-ad22175cc534 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:41.902117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6567ec41-a145-4435-9ac5-ad22175cc534 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:41.902567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6567ec41-a145-4435-9ac5-ad22175cc534 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:41.903321 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6567ec41-a145-4435-9ac5-ad22175cc534 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.255419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6567ec41-a145-4435-9ac5-ad22175cc534 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "POST /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.368748 Aug 30 02:00:42.256731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 312/658] 10.222.0.50 () {62 vars in 1364 bytes} [Tue Aug 30 02:00:41 2022] POST /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 188 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:00:42.441176 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9319ec23-7fa2-470a-9ef3-a8ec47f31d45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:00:42.442303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9319ec23-7fa2-470a-9ef3-a8ec47f31d45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:42.449729 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9319ec23-7fa2-470a-9ef3-a8ec47f31d45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.450249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9319ec23-7fa2-470a-9ef3-a8ec47f31d45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.450686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9319ec23-7fa2-470a-9ef3-a8ec47f31d45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.451386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9319ec23-7fa2-470a-9ef3-a8ec47f31d45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.451836 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9319ec23-7fa2-470a-9ef3-a8ec47f31d45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.452273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9319ec23-7fa2-470a-9ef3-a8ec47f31d45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.468633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-edd01b85-1097-49c9-a2f8-b4098d6395ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:42.469220 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-edd01b85-1097-49c9-a2f8-b4098d6395ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:42.481627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edd01b85-1097-49c9-a2f8-b4098d6395ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.482424 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edd01b85-1097-49c9-a2f8-b4098d6395ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.483763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edd01b85-1097-49c9-a2f8-b4098d6395ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.484699 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edd01b85-1097-49c9-a2f8-b4098d6395ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.486080 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edd01b85-1097-49c9-a2f8-b4098d6395ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.486732 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-edd01b85-1097-49c9-a2f8-b4098d6395ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.674150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9319ec23-7fa2-470a-9ef3-a8ec47f31d45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120391) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 02:00:42.674538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-edd01b85-1097-49c9-a2f8-b4098d6395ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:42.689637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-edd01b85-1097-49c9-a2f8-b4098d6395ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.229068 Aug 30 02:00:42.692749 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 313/659] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:42 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:42.700229 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e8265305-fef7-401a-8f86-d2205711f1d0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:42.701123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e8265305-fef7-401a-8f86-d2205711f1d0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:42.707643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e8265305-fef7-401a-8f86-d2205711f1d0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.708367 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e8265305-fef7-401a-8f86-d2205711f1d0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.708793 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e8265305-fef7-401a-8f86-d2205711f1d0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.709689 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e8265305-fef7-401a-8f86-d2205711f1d0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.710137 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e8265305-fef7-401a-8f86-d2205711f1d0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.710554 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e8265305-fef7-401a-8f86-d2205711f1d0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.732738 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:42.758923 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9319ec23-7fa2-470a-9ef3-a8ec47f31d45 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "POST /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/action" status: 202 len: 0 microversion: 2.20 time: 0.320180 Aug 30 02:00:42.760145 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 347/660] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 02:00:42 2022] POST /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:00:42.765306 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-abe2803d-7e88-4028-abf0-c7eb0c8b8203 req-fe289f08-3953-402d-b2ea-0d6d35b09e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33e0127-93b8-4cdb-913a-5863f403890e", "name": "network-vif-deleted", "tag": "d2f0275f-d1ef-439d-83db-d9568b347aca"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:00:42.781713 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-abe2803d-7e88-4028-abf0-c7eb0c8b8203 req-fe289f08-3953-402d-b2ea-0d6d35b09e08 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.782989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-abe2803d-7e88-4028-abf0-c7eb0c8b8203 req-fe289f08-3953-402d-b2ea-0d6d35b09e08 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.783798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-abe2803d-7e88-4028-abf0-c7eb0c8b8203 req-fe289f08-3953-402d-b2ea-0d6d35b09e08 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.797447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e8265305-fef7-401a-8f86-d2205711f1d0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:42.802245 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-abe2803d-7e88-4028-abf0-c7eb0c8b8203 req-fe289f08-3953-402d-b2ea-0d6d35b09e08 service nova] Creating event network-vif-deleted:d2f0275f-d1ef-439d-83db-d9568b347aca for instance e33e0127-93b8-4cdb-913a-5863f403890e on hv-cinder-81966 Aug 30 02:00:42.808062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e8265305-fef7-401a-8f86-d2205711f1d0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1472 microversion: 2.1 time: 0.113588 Aug 30 02:00:42.808630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-abe2803d-7e88-4028-abf0-c7eb0c8b8203 req-fe289f08-3953-402d-b2ea-0d6d35b09e08 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047197 Aug 30 02:00:42.809572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 348/662] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:00:42.809766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 314/662] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:42 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1472 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:42.815630 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:42.816418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:42.820599 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7b78167d-a470-46bb-ba54-335e6729fa28 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:42.822188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7b78167d-a470-46bb-ba54-335e6729fa28 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:42.826694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.829038 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.830411 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7b78167d-a470-46bb-ba54-335e6729fa28 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.830771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.830903 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7b78167d-a470-46bb-ba54-335e6729fa28 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.831432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7b78167d-a470-46bb-ba54-335e6729fa28 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.832066 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7b78167d-a470-46bb-ba54-335e6729fa28 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.832385 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:42.832546 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7b78167d-a470-46bb-ba54-335e6729fa28 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.832965 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7b78167d-a470-46bb-ba54-335e6729fa28 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:42.833314 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:42.833979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:43.002705 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7b78167d-a470-46bb-ba54-335e6729fa28 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:43.012967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7b78167d-a470-46bb-ba54-335e6729fa28 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.198885 Aug 30 02:00:43.028045 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 349/663] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:42 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:43.028771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:43.037976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:43.039418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:43.040652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5c5ccc68-4e06-4f0d-ae2e-090042b1a804 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1808 microversion: 2.20 time: 0.229355 Aug 30 02:00:43.045029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 315/664] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:42 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:43.715542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9226eb42-2e32-4ae3-a699-0e6d1457c4ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:43.716084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9226eb42-2e32-4ae3-a699-0e6d1457c4ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:43.722966 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9226eb42-2e32-4ae3-a699-0e6d1457c4ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:43.723444 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9226eb42-2e32-4ae3-a699-0e6d1457c4ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:43.723868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9226eb42-2e32-4ae3-a699-0e6d1457c4ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:43.724880 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9226eb42-2e32-4ae3-a699-0e6d1457c4ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:43.725208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9226eb42-2e32-4ae3-a699-0e6d1457c4ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:43.725625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9226eb42-2e32-4ae3-a699-0e6d1457c4ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:43.833610 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:43.834360 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:43.842579 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:43.843584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:43.845794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:43.848871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:43.849977 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:43.850471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:43.879579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9226eb42-2e32-4ae3-a699-0e6d1457c4ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:43.885869 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:43.886578 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:43.887169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:43.887767 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lazy-loading 'fault' on Instance uuid e33e0127-93b8-4cdb-913a-5863f403890e {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:00:43.889672 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9226eb42-2e32-4ae3-a699-0e6d1457c4ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.178464 Aug 30 02:00:43.904539 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 350/665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:43 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:43.943978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:43.953751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d33bed03-5ed6-42b9-8791-2303233425ee tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 200 len: 1309 microversion: 2.1 time: 0.123951 Aug 30 02:00:43.954328 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 316/666] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:43 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 1309 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:44.034035 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-850d58ec-1111-4085-ba6b-c4f23c2be155 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:44.034636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-850d58ec-1111-4085-ba6b-c4f23c2be155 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:44.041414 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-850d58ec-1111-4085-ba6b-c4f23c2be155 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:44.041891 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-850d58ec-1111-4085-ba6b-c4f23c2be155 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:44.042317 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-850d58ec-1111-4085-ba6b-c4f23c2be155 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:44.042988 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-850d58ec-1111-4085-ba6b-c4f23c2be155 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:44.043436 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-850d58ec-1111-4085-ba6b-c4f23c2be155 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:44.043889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-850d58ec-1111-4085-ba6b-c4f23c2be155 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:44.046551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:44.064817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:44.065586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:44.071641 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:44.072214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:44.072749 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:44.073504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:44.074029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:44.074522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:44.177719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-850d58ec-1111-4085-ba6b-c4f23c2be155 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:44.186389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-850d58ec-1111-4085-ba6b-c4f23c2be155 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.156176 Aug 30 02:00:44.186961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 351/667] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:44 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:44.201800 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:44.210283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:44.211711 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:44.212882 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1dde7c8d-4e78-4121-9d4a-fc67d705b5b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1750 microversion: 2.20 time: 0.152313 Aug 30 02:00:44.213435 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 317/668] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:44 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:44.910277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bcc461eb-8384-4251-b46d-b4162df72e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:44.910829 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bcc461eb-8384-4251-b46d-b4162df72e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:44.918395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc461eb-8384-4251-b46d-b4162df72e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:44.918908 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc461eb-8384-4251-b46d-b4162df72e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:44.919544 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc461eb-8384-4251-b46d-b4162df72e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:44.920455 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc461eb-8384-4251-b46d-b4162df72e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:44.920975 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc461eb-8384-4251-b46d-b4162df72e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:44.921399 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc461eb-8384-4251-b46d-b4162df72e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:44.973858 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:44.974468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: e33e0127-93b8-4cdb-913a-5863f403890e] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:44.981513 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:44.981991 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:44.982418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:44.983100 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:44.983551 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:44.983989 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:45.002417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] HTTP exception thrown: Instance e33e0127-93b8-4cdb-913a-5863f403890e could not be found. Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Request method failure captured: Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e HTTP/1.1 Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW6119Y7Yh3IjThgPlOzkiTvKGNlaCuAmf9aECYIGP7v9nsu1K16U18iMWLTt985SiJiMZvdqFX3hxnNUar0C3rMRgUkaMeek0tOSxSrj0BMiV88315VqAB-4edNmQM5P0vpIvBFyogDbovc58D4Mb-Z_sH-3bbntquY65MXuhPB4QA Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 4d07d38e84224c9282dea262e712e4e3 Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1808045730 Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:00:45.004058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4d07d38e84224c9282dea262e712e4e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4d07d38e84224c9282dea262e712e4e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4d07d38e84224c9282dea262e712e4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4d07d38e84224c9282dea262e712e4e3"}]}] Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesSnapshotTestJSON-1808045730 Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 4d07d38e84224c9282dea262e712e4e3 Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1808045730 Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesSnapshotTestJSON-1808045730-project Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 0646d81951fa4353bdfb59048b498652 Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesSnapshotTestJSON-1808045730-project Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance e33e0127-93b8-4cdb-913a-5863f403890e could not be found. Aug 30 02:00:45.005994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': 'e33e0127-93b8-4cdb-913a-5863f403890e'} Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33e0127-93b8-4cdb-913a-5863f403890e could not be found. Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:00:45.006936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33e0127-93b8-4cdb-913a-5863f403890e could not be found. Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33e0127-93b8-4cdb-913a-5863f403890e could not be found. Aug 30 02:00:45.008825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:00:45.010104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Returning 404 to user: Instance e33e0127-93b8-4cdb-913a-5863f403890e could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:00:45.010104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-322dc701-3342-4944-bcbb-bffc626acdc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e" status: 404 len: 111 microversion: 2.1 time: 0.035426 Aug 30 02:00:45.010104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 318/669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:44 2022] GET /compute/v2.1/servers/e33e0127-93b8-4cdb-913a-5863f403890e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:00:45.057053 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-bcc461eb-8384-4251-b46d-b4162df72e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:45.064779 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bcc461eb-8384-4251-b46d-b4162df72e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.158704 Aug 30 02:00:45.065427 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 352/670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:44 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:45.207229 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6d60d6ba-945a-48d0-b8ae-de3722249d10 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:45.208003 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6d60d6ba-945a-48d0-b8ae-de3722249d10 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:45.214280 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6d60d6ba-945a-48d0-b8ae-de3722249d10 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:45.214808 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6d60d6ba-945a-48d0-b8ae-de3722249d10 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:45.215275 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6d60d6ba-945a-48d0-b8ae-de3722249d10 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:45.216163 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6d60d6ba-945a-48d0-b8ae-de3722249d10 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:45.216644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6d60d6ba-945a-48d0-b8ae-de3722249d10 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:45.217096 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6d60d6ba-945a-48d0-b8ae-de3722249d10 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:45.236106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:45.236738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:45.242590 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:45.243603 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:45.244034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:45.244831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:45.245325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:45.245673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:45.349069 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6d60d6ba-945a-48d0-b8ae-de3722249d10 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:45.357307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6d60d6ba-945a-48d0-b8ae-de3722249d10 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.154359 Aug 30 02:00:45.357895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 319/671] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:45 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:45.382448 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:45.391486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:45.392966 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:45.394110 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-73986b0a-d5ea-4e56-8e8e-6816d653330f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1750 microversion: 2.20 time: 0.161994 Aug 30 02:00:45.394659 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 353/672] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:45 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:46.087437 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-21a96f34-b72e-4a83-a4cf-3c2152670cfe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:46.088044 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-21a96f34-b72e-4a83-a4cf-3c2152670cfe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:46.094498 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21a96f34-b72e-4a83-a4cf-3c2152670cfe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:46.095024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21a96f34-b72e-4a83-a4cf-3c2152670cfe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:46.095457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21a96f34-b72e-4a83-a4cf-3c2152670cfe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:46.096140 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21a96f34-b72e-4a83-a4cf-3c2152670cfe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:46.096620 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21a96f34-b72e-4a83-a4cf-3c2152670cfe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:46.097044 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21a96f34-b72e-4a83-a4cf-3c2152670cfe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:46.225870 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-21a96f34-b72e-4a83-a4cf-3c2152670cfe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:46.234133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-21a96f34-b72e-4a83-a4cf-3c2152670cfe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.151139 Aug 30 02:00:46.234676 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 320/673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:46 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:46.379122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-06f75c63-d754-4da6-8fcf-c6b94d556657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:46.380072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-06f75c63-d754-4da6-8fcf-c6b94d556657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:46.389323 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06f75c63-d754-4da6-8fcf-c6b94d556657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:46.389799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06f75c63-d754-4da6-8fcf-c6b94d556657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:46.390227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06f75c63-d754-4da6-8fcf-c6b94d556657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:46.390903 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06f75c63-d754-4da6-8fcf-c6b94d556657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:46.391350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06f75c63-d754-4da6-8fcf-c6b94d556657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:46.391766 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06f75c63-d754-4da6-8fcf-c6b94d556657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:46.417315 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:46.417920 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:46.423854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:46.424371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:46.424808 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:46.425500 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:46.425953 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:46.426377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:46.520805 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-06f75c63-d754-4da6-8fcf-c6b94d556657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:46.528968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-06f75c63-d754-4da6-8fcf-c6b94d556657 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.153825 Aug 30 02:00:46.529567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 354/674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:46 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:46.559776 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:46.568208 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:46.569651 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:46.570818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8f51c07f-be17-4a50-bc53-49009451b560 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1750 microversion: 2.20 time: 0.157999 Aug 30 02:00:46.571358 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 321/675] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:46 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:47.253173 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-344f6986-047e-4f60-b42b-bcfbb065fe36 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:47.256121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-344f6986-047e-4f60-b42b-bcfbb065fe36 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:47.262053 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-344f6986-047e-4f60-b42b-bcfbb065fe36 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:47.262532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-344f6986-047e-4f60-b42b-bcfbb065fe36 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:47.262963 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-344f6986-047e-4f60-b42b-bcfbb065fe36 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:47.263694 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-344f6986-047e-4f60-b42b-bcfbb065fe36 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:47.264174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-344f6986-047e-4f60-b42b-bcfbb065fe36 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:47.264615 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-344f6986-047e-4f60-b42b-bcfbb065fe36 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:47.392377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-344f6986-047e-4f60-b42b-bcfbb065fe36 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:47.400279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-344f6986-047e-4f60-b42b-bcfbb065fe36 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.150896 Aug 30 02:00:47.400832 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 355/676] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:47 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:47.550486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a9bf0356-fa71-4bc9-8cc3-8d96cef28f52 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:47.551020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a9bf0356-fa71-4bc9-8cc3-8d96cef28f52 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:47.557361 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9bf0356-fa71-4bc9-8cc3-8d96cef28f52 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:47.557838 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9bf0356-fa71-4bc9-8cc3-8d96cef28f52 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:47.558265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9bf0356-fa71-4bc9-8cc3-8d96cef28f52 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:47.558940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9bf0356-fa71-4bc9-8cc3-8d96cef28f52 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:47.559387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9bf0356-fa71-4bc9-8cc3-8d96cef28f52 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:47.559809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9bf0356-fa71-4bc9-8cc3-8d96cef28f52 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:47.593450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:47.594060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:47.599934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:47.600453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:47.600894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:47.601584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:47.602114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:47.603040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:47.688458 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a9bf0356-fa71-4bc9-8cc3-8d96cef28f52 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:47.696942 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a9bf0356-fa71-4bc9-8cc3-8d96cef28f52 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.150339 Aug 30 02:00:47.697504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 322/677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:47 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:47.730018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:47.738365 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:47.739789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:47.741061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b107abf8-8bea-4f21-b188-bd7a4e0e085d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1750 microversion: 2.20 time: 0.151510 Aug 30 02:00:47.741658 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 356/678] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:47 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:48.340289 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-dcef82f8-b1b5-45f1-b48a-4cd817fd21f8 req-10a4d35f-78a6-4ee5-9d47-244e02837e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f56e8b-8c6b-469a-a47d-40fb70a05cb0", "name": "network-vif-plugged", "status": "completed", "tag": "c1a5815c-8f17-48df-ae71-427b9c4db05f"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:00:48.350599 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dcef82f8-b1b5-45f1-b48a-4cd817fd21f8 req-10a4d35f-78a6-4ee5-9d47-244e02837e56 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:48.351101 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dcef82f8-b1b5-45f1-b48a-4cd817fd21f8 req-10a4d35f-78a6-4ee5-9d47-244e02837e56 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:48.351526 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dcef82f8-b1b5-45f1-b48a-4cd817fd21f8 req-10a4d35f-78a6-4ee5-9d47-244e02837e56 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:48.363723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-dcef82f8-b1b5-45f1-b48a-4cd817fd21f8 req-10a4d35f-78a6-4ee5-9d47-244e02837e56 service nova] Creating event network-vif-plugged:c1a5815c-8f17-48df-ae71-427b9c4db05f for instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 on hv-cinder-81966 Aug 30 02:00:48.369251 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-dcef82f8-b1b5-45f1-b48a-4cd817fd21f8 req-10a4d35f-78a6-4ee5-9d47-244e02837e56 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033372 Aug 30 02:00:48.369820 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 323/679] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:00:48.420914 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6002598a-daed-4052-aef7-524c018c4c51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:48.422099 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6002598a-daed-4052-aef7-524c018c4c51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:48.428805 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6002598a-daed-4052-aef7-524c018c4c51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:48.429289 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6002598a-daed-4052-aef7-524c018c4c51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:48.429694 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6002598a-daed-4052-aef7-524c018c4c51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:48.431191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6002598a-daed-4052-aef7-524c018c4c51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:48.431704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6002598a-daed-4052-aef7-524c018c4c51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:48.432027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6002598a-daed-4052-aef7-524c018c4c51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:48.674986 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6002598a-daed-4052-aef7-524c018c4c51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:48.683477 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6002598a-daed-4052-aef7-524c018c4c51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.266336 Aug 30 02:00:48.685390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 357/680] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:48 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:48.720011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2f6198e6-e2f0-48fb-bade-df6e89478bcc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:48.720407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2f6198e6-e2f0-48fb-bade-df6e89478bcc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:48.726398 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f6198e6-e2f0-48fb-bade-df6e89478bcc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:48.727011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f6198e6-e2f0-48fb-bade-df6e89478bcc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:48.727451 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f6198e6-e2f0-48fb-bade-df6e89478bcc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:48.728147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f6198e6-e2f0-48fb-bade-df6e89478bcc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:48.728640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f6198e6-e2f0-48fb-bade-df6e89478bcc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:48.729069 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f6198e6-e2f0-48fb-bade-df6e89478bcc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:48.764507 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:48.765138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:48.770999 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:48.771471 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:48.771898 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:48.772601 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:48.773044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:48.773456 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:48.862232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2f6198e6-e2f0-48fb-bade-df6e89478bcc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:48.870918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2f6198e6-e2f0-48fb-bade-df6e89478bcc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.155964 Aug 30 02:00:48.871557 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 324/681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:48 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:48.917137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:48.926215 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:48.927640 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:48.928816 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ea82db5e-561a-40b7-8c1c-29e0caaa9558 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1750 microversion: 2.20 time: 0.168303 Aug 30 02:00:48.929384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 358/682] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:48 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:49.705039 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e02dd170-66ff-42f2-b9c2-0384d94714d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:49.705570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e02dd170-66ff-42f2-b9c2-0384d94714d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:49.712057 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e02dd170-66ff-42f2-b9c2-0384d94714d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:49.712567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e02dd170-66ff-42f2-b9c2-0384d94714d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:49.713000 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e02dd170-66ff-42f2-b9c2-0384d94714d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:49.713684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e02dd170-66ff-42f2-b9c2-0384d94714d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:49.714136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e02dd170-66ff-42f2-b9c2-0384d94714d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:49.714865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e02dd170-66ff-42f2-b9c2-0384d94714d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:49.840652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e02dd170-66ff-42f2-b9c2-0384d94714d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:49.848178 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e02dd170-66ff-42f2-b9c2-0384d94714d9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.147019 Aug 30 02:00:49.848766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 325/683] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:49 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:49.892611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-14844094-eda9-4c9f-8291-038e28e05d45 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:49.893210 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-14844094-eda9-4c9f-8291-038e28e05d45 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:49.899989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14844094-eda9-4c9f-8291-038e28e05d45 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:49.900491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14844094-eda9-4c9f-8291-038e28e05d45 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:49.900921 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14844094-eda9-4c9f-8291-038e28e05d45 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:49.901602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14844094-eda9-4c9f-8291-038e28e05d45 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:49.902048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14844094-eda9-4c9f-8291-038e28e05d45 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:49.902462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-14844094-eda9-4c9f-8291-038e28e05d45 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:49.953413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:49.954022 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:49.960169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:49.963016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:49.963467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:49.964551 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:49.964859 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:49.965471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:50.035968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-14844094-eda9-4c9f-8291-038e28e05d45 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:50.044651 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-14844094-eda9-4c9f-8291-038e28e05d45 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.155721 Aug 30 02:00:50.045216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 359/684] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:49 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:50.093285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:50.102135 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:50.103679 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:50.104919 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-39fb524d-db85-4471-96bd-a7f050890f15 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1750 microversion: 2.20 time: 0.155376 Aug 30 02:00:50.105476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 326/685] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:49 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:50.869005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-76ffefce-feed-435d-ac38-84552ec2c7d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:50.869619 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-76ffefce-feed-435d-ac38-84552ec2c7d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:50.875820 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76ffefce-feed-435d-ac38-84552ec2c7d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:50.876333 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76ffefce-feed-435d-ac38-84552ec2c7d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:50.876767 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76ffefce-feed-435d-ac38-84552ec2c7d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:50.877453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76ffefce-feed-435d-ac38-84552ec2c7d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:50.877900 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76ffefce-feed-435d-ac38-84552ec2c7d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:50.878320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76ffefce-feed-435d-ac38-84552ec2c7d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:51.005924 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-76ffefce-feed-435d-ac38-84552ec2c7d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:51.015110 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-76ffefce-feed-435d-ac38-84552ec2c7d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.149882 Aug 30 02:00:51.015673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 360/686] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:50 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:51.065322 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f363f907-fa24-43a7-8722-45282a066426 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:51.065922 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f363f907-fa24-43a7-8722-45282a066426 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:51.072812 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f363f907-fa24-43a7-8722-45282a066426 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:51.073286 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f363f907-fa24-43a7-8722-45282a066426 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:51.073710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f363f907-fa24-43a7-8722-45282a066426 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:51.074386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f363f907-fa24-43a7-8722-45282a066426 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:51.074828 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f363f907-fa24-43a7-8722-45282a066426 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:51.075247 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f363f907-fa24-43a7-8722-45282a066426 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:51.128379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:51.128895 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:51.135537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:51.136009 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:51.136463 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:51.137143 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:51.137585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:51.137998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:51.204787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f363f907-fa24-43a7-8722-45282a066426 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:51.214484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f363f907-fa24-43a7-8722-45282a066426 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.152708 Aug 30 02:00:51.215031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 327/687] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:51 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:51.269369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:51.278421 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:51.279945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:51.281260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-31e959a3-a8f4-40d8-a6e5-fa9665144c74 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1750 microversion: 2.20 time: 0.156770 Aug 30 02:00:51.281855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 361/688] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:51 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:52.034939 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4922c317-94e6-49f3-91f0-3788904f9025 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:52.035605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4922c317-94e6-49f3-91f0-3788904f9025 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:52.042037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4922c317-94e6-49f3-91f0-3788904f9025 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:52.042519 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4922c317-94e6-49f3-91f0-3788904f9025 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:52.042955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4922c317-94e6-49f3-91f0-3788904f9025 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:52.043668 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4922c317-94e6-49f3-91f0-3788904f9025 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:52.044146 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4922c317-94e6-49f3-91f0-3788904f9025 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:52.044625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4922c317-94e6-49f3-91f0-3788904f9025 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:52.174259 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4922c317-94e6-49f3-91f0-3788904f9025 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:52.181716 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4922c317-94e6-49f3-91f0-3788904f9025 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.150756 Aug 30 02:00:52.182274 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 328/689] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:52 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:52.235208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7d1ae5b9-fb5d-4078-8c6e-45d1d571a79b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:52.235812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7d1ae5b9-fb5d-4078-8c6e-45d1d571a79b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:52.242084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d1ae5b9-fb5d-4078-8c6e-45d1d571a79b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:52.242575 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d1ae5b9-fb5d-4078-8c6e-45d1d571a79b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:52.243003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d1ae5b9-fb5d-4078-8c6e-45d1d571a79b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:52.243677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d1ae5b9-fb5d-4078-8c6e-45d1d571a79b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:52.244125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d1ae5b9-fb5d-4078-8c6e-45d1d571a79b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:52.244566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d1ae5b9-fb5d-4078-8c6e-45d1d571a79b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:52.304808 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:52.305647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:52.311415 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:52.311889 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:52.312344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:52.313022 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:52.313471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:52.313890 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:52.371255 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7d1ae5b9-fb5d-4078-8c6e-45d1d571a79b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:52.379395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7d1ae5b9-fb5d-4078-8c6e-45d1d571a79b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.147928 Aug 30 02:00:52.380767 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 362/690] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:52 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:52.457499 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:52.466633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:52.468076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:52.469300 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c7adb6ed-94cc-4024-ac1f-e26996eb2e73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1750 microversion: 2.20 time: 0.168382 Aug 30 02:00:52.469859 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 329/691] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:52 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:53.202238 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b02f45b6-a5fc-450a-97fe-ada8aa1bbea6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:53.202852 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b02f45b6-a5fc-450a-97fe-ada8aa1bbea6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:53.208859 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b02f45b6-a5fc-450a-97fe-ada8aa1bbea6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:53.209333 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b02f45b6-a5fc-450a-97fe-ada8aa1bbea6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:53.209758 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b02f45b6-a5fc-450a-97fe-ada8aa1bbea6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:53.210433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b02f45b6-a5fc-450a-97fe-ada8aa1bbea6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:53.210882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b02f45b6-a5fc-450a-97fe-ada8aa1bbea6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:53.211922 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b02f45b6-a5fc-450a-97fe-ada8aa1bbea6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:53.338012 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b02f45b6-a5fc-450a-97fe-ada8aa1bbea6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:53.346125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b02f45b6-a5fc-450a-97fe-ada8aa1bbea6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.147717 Aug 30 02:00:53.346685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 363/692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:53 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:53.403310 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d96a491d-d1f7-4874-a78d-04ebfd316f1c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:53.403911 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d96a491d-d1f7-4874-a78d-04ebfd316f1c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:53.410322 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d96a491d-d1f7-4874-a78d-04ebfd316f1c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:53.410801 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d96a491d-d1f7-4874-a78d-04ebfd316f1c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:53.411234 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d96a491d-d1f7-4874-a78d-04ebfd316f1c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:53.411912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d96a491d-d1f7-4874-a78d-04ebfd316f1c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:53.412388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d96a491d-d1f7-4874-a78d-04ebfd316f1c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:53.412804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d96a491d-d1f7-4874-a78d-04ebfd316f1c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:53.492386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:53.493508 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:53.499318 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:53.499788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:53.500214 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:53.500928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:53.501377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:53.501799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:53.542179 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d96a491d-d1f7-4874-a78d-04ebfd316f1c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:53.550409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d96a491d-d1f7-4874-a78d-04ebfd316f1c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.151551 Aug 30 02:00:53.550978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 330/693] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:53 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:53.632470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:53.640994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:53.642418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:53.643587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0572bec9-6229-40a5-8747-1bec57e4dfe6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1750 microversion: 2.20 time: 0.155176 Aug 30 02:00:53.644141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 364/694] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:53 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:54.366615 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c5ced2a8-6f3a-4343-9be1-5a835fbd7edf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:54.367189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c5ced2a8-6f3a-4343-9be1-5a835fbd7edf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:54.373113 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ced2a8-6f3a-4343-9be1-5a835fbd7edf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:54.373599 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ced2a8-6f3a-4343-9be1-5a835fbd7edf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:54.374034 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ced2a8-6f3a-4343-9be1-5a835fbd7edf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:54.374804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ced2a8-6f3a-4343-9be1-5a835fbd7edf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:54.375274 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ced2a8-6f3a-4343-9be1-5a835fbd7edf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:54.375698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c5ced2a8-6f3a-4343-9be1-5a835fbd7edf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:54.504345 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c5ced2a8-6f3a-4343-9be1-5a835fbd7edf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:54.512490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c5ced2a8-6f3a-4343-9be1-5a835fbd7edf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1368 microversion: 2.1 time: 0.149728 Aug 30 02:00:54.513384 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 331/695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:54 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:54.573929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-65702f59-5d8c-45cb-9ef6-8581a42aa6e8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:54.574550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-65702f59-5d8c-45cb-9ef6-8581a42aa6e8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:54.577279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:54.584521 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65702f59-5d8c-45cb-9ef6-8581a42aa6e8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:54.584910 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65702f59-5d8c-45cb-9ef6-8581a42aa6e8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:54.585492 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65702f59-5d8c-45cb-9ef6-8581a42aa6e8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:54.586970 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65702f59-5d8c-45cb-9ef6-8581a42aa6e8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:54.587142 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65702f59-5d8c-45cb-9ef6-8581a42aa6e8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:54.587561 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65702f59-5d8c-45cb-9ef6-8581a42aa6e8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:54.666960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:54.667973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:54.674891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:54.675378 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:54.675806 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:54.676595 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:54.677038 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:54.677455 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:54.681714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:54.725826 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-65702f59-5d8c-45cb-9ef6-8581a42aa6e8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:54.734101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-65702f59-5d8c-45cb-9ef6-8581a42aa6e8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.166595 Aug 30 02:00:54.734679 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 365/696] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:54 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:54.817791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:54.827044 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:54.828501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:54.829698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-271132ec-6ea3-4329-8942-556d5cbdb2b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1750 microversion: 2.20 time: 0.166595 Aug 30 02:00:54.830211 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 332/697] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:54 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:55.533281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-746dc13f-9eb9-4958-a4ed-44a7d4c1eb45 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:55.533888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-746dc13f-9eb9-4958-a4ed-44a7d4c1eb45 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:55.539682 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-746dc13f-9eb9-4958-a4ed-44a7d4c1eb45 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:55.540158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-746dc13f-9eb9-4958-a4ed-44a7d4c1eb45 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:55.540623 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-746dc13f-9eb9-4958-a4ed-44a7d4c1eb45 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:55.541307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-746dc13f-9eb9-4958-a4ed-44a7d4c1eb45 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:55.541758 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-746dc13f-9eb9-4958-a4ed-44a7d4c1eb45 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:55.542181 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-746dc13f-9eb9-4958-a4ed-44a7d4c1eb45 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:55.682736 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-746dc13f-9eb9-4958-a4ed-44a7d4c1eb45 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:55.690450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-746dc13f-9eb9-4958-a4ed-44a7d4c1eb45 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1557 microversion: 2.1 time: 0.160951 Aug 30 02:00:55.691015 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 366/698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:55 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:00:55.711763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-76d0d4dc-c065-4647-9907-9da10fe2f601 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:55.712453 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-76d0d4dc-c065-4647-9907-9da10fe2f601 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:55.719083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-76d0d4dc-c065-4647-9907-9da10fe2f601 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:55.719765 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-76d0d4dc-c065-4647-9907-9da10fe2f601 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:55.720438 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-76d0d4dc-c065-4647-9907-9da10fe2f601 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:55.721294 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-76d0d4dc-c065-4647-9907-9da10fe2f601 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:55.722098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-76d0d4dc-c065-4647-9907-9da10fe2f601 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:55.724819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-76d0d4dc-c065-4647-9907-9da10fe2f601 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:55.767704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-feb71fe5-a71a-4b4f-b135-c3aa2198eb81 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:55.768649 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-feb71fe5-a71a-4b4f-b135-c3aa2198eb81 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:55.775401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-feb71fe5-a71a-4b4f-b135-c3aa2198eb81 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:55.776199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-feb71fe5-a71a-4b4f-b135-c3aa2198eb81 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:55.776758 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-feb71fe5-a71a-4b4f-b135-c3aa2198eb81 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:55.777659 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-feb71fe5-a71a-4b4f-b135-c3aa2198eb81 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:55.778491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-feb71fe5-a71a-4b4f-b135-c3aa2198eb81 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:55.779140 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-feb71fe5-a71a-4b4f-b135-c3aa2198eb81 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:55.818389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-76d0d4dc-c065-4647-9907-9da10fe2f601 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110888 Aug 30 02:00:55.819164 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 333/699] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 02:00:55 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:00:55.854961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:55.855924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:55.866357 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:55.867164 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:55.868541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:55.871587 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:55.872738 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:55.873496 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:56.010246 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-feb71fe5-a71a-4b4f-b135-c3aa2198eb81 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:56.012468 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:56.021969 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-feb71fe5-a71a-4b4f-b135-c3aa2198eb81 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.261617 Aug 30 02:00:56.025176 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 367/700] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:55 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:56.179784 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:56.193734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:56.195168 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:56.196400 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-320bbd96-0621-41ab-91c2-05e08447614d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.347309 Aug 30 02:00:56.197133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 334/701] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:55 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:56.911555 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-a11c085e-b09f-483d-8f58-aa6698b238a8 req-d2ede3ce-24c3-4447-9f65-77c04d61d3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f56e8b-8c6b-469a-a47d-40fb70a05cb0", "tag": "c1a5815c-8f17-48df-ae71-427b9c4db05f"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:00:56.931131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-a11c085e-b09f-483d-8f58-aa6698b238a8 req-d2ede3ce-24c3-4447-9f65-77c04d61d3e2 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:56.931991 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-a11c085e-b09f-483d-8f58-aa6698b238a8 req-d2ede3ce-24c3-4447-9f65-77c04d61d3e2 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:56.932713 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-a11c085e-b09f-483d-8f58-aa6698b238a8 req-d2ede3ce-24c3-4447-9f65-77c04d61d3e2 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:56.972998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-a11c085e-b09f-483d-8f58-aa6698b238a8 req-d2ede3ce-24c3-4447-9f65-77c04d61d3e2 service nova] Creating event network-changed:c1a5815c-8f17-48df-ae71-427b9c4db05f for instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 on hv-cinder-81966 Aug 30 02:00:56.981140 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-a11c085e-b09f-483d-8f58-aa6698b238a8 req-d2ede3ce-24c3-4447-9f65-77c04d61d3e2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073394 Aug 30 02:00:56.982888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 368/702] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:00:57.046316 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-96995c83-e3fb-402c-a2c9-b2b91a24648e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:57.047610 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-96995c83-e3fb-402c-a2c9-b2b91a24648e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:57.055013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96995c83-e3fb-402c-a2c9-b2b91a24648e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:57.056278 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96995c83-e3fb-402c-a2c9-b2b91a24648e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:57.056966 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96995c83-e3fb-402c-a2c9-b2b91a24648e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:57.057891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96995c83-e3fb-402c-a2c9-b2b91a24648e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:57.058556 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96995c83-e3fb-402c-a2c9-b2b91a24648e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:57.059189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96995c83-e3fb-402c-a2c9-b2b91a24648e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:57.214716 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-96995c83-e3fb-402c-a2c9-b2b91a24648e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:57.223313 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-96995c83-e3fb-402c-a2c9-b2b91a24648e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.180671 Aug 30 02:00:57.223892 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:57.224980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 335/703] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:57 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:57.225795 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:57.232794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:57.234089 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:57.235095 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:57.236032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:57.236709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:57.237353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:57.688763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:57.703361 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:57.704846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:57.706015 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5f973eb4-505b-458e-93c4-4d7d315960da tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.490135 Aug 30 02:00:57.706900 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 369/704] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:57 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:58.247167 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f0a84bfc-0176-4cc4-b57c-2118df8fd2d1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:58.247780 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f0a84bfc-0176-4cc4-b57c-2118df8fd2d1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:58.255126 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a84bfc-0176-4cc4-b57c-2118df8fd2d1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:58.256125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a84bfc-0176-4cc4-b57c-2118df8fd2d1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:58.256776 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a84bfc-0176-4cc4-b57c-2118df8fd2d1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:58.257478 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a84bfc-0176-4cc4-b57c-2118df8fd2d1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:58.258719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a84bfc-0176-4cc4-b57c-2118df8fd2d1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:58.259271 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0a84bfc-0176-4cc4-b57c-2118df8fd2d1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:58.704064 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f0a84bfc-0176-4cc4-b57c-2118df8fd2d1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:58.712608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f0a84bfc-0176-4cc4-b57c-2118df8fd2d1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.470737 Aug 30 02:00:58.713246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 336/705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:58 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:58.729915 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:58.730625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:58.737142 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:58.737858 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:58.738286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:58.738971 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:58.739417 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:58.739831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:58.887595 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:58.896115 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:58.897604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:58.899278 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-30f6fd5f-d117-4db7-88d6-0b391e6e7f14 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.173441 Aug 30 02:00:58.899824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 370/706] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:58 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:00:59.735890 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1dd5be06-eb06-4ae2-b720-e8ea56c08119 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:59.736633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1dd5be06-eb06-4ae2-b720-e8ea56c08119 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:59.744056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dd5be06-eb06-4ae2-b720-e8ea56c08119 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:59.744640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dd5be06-eb06-4ae2-b720-e8ea56c08119 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:59.745136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dd5be06-eb06-4ae2-b720-e8ea56c08119 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:59.745888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dd5be06-eb06-4ae2-b720-e8ea56c08119 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:59.746452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dd5be06-eb06-4ae2-b720-e8ea56c08119 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:59.746936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1dd5be06-eb06-4ae2-b720-e8ea56c08119 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:59.925439 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:59.925989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:00:59.937732 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:59.941226 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:59.943085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:59.945637 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:59.946429 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:59.946862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:59.974748 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1dd5be06-eb06-4ae2-b720-e8ea56c08119 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:00:59.987942 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1dd5be06-eb06-4ae2-b720-e8ea56c08119 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.255690 Aug 30 02:00:59.989231 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 337/707] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:00:59 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:00.106558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:00.118934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:00.121013 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:00.123292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5d55a1de-7804-4f0e-ab55-cb9da7241345 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.202584 Aug 30 02:01:00.123292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 371/708] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:00:59 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:01.011613 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a392e1dc-8dbd-4b8b-b876-5fd21584c3e0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:01.013056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a392e1dc-8dbd-4b8b-b876-5fd21584c3e0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:01.021352 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a392e1dc-8dbd-4b8b-b876-5fd21584c3e0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:01.024705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a392e1dc-8dbd-4b8b-b876-5fd21584c3e0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:01.025343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a392e1dc-8dbd-4b8b-b876-5fd21584c3e0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:01.026263 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a392e1dc-8dbd-4b8b-b876-5fd21584c3e0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:01.026880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a392e1dc-8dbd-4b8b-b876-5fd21584c3e0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:01.027473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a392e1dc-8dbd-4b8b-b876-5fd21584c3e0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:01.146812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:01.147778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:01.157994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:01.157994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:01.158390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:01.159420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:01.159880 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:01.160434 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:01.379404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a392e1dc-8dbd-4b8b-b876-5fd21584c3e0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:01.415575 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a392e1dc-8dbd-4b8b-b876-5fd21584c3e0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.406142 Aug 30 02:01:01.420862 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 338/709] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:01 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:01.429760 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-133556413", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "networks": [{"uuid": "f9f80911-cdea-4592-abdd-3859ccadc0fb"}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:01.532830 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] validate_networks() for [('f9f80911-cdea-4592-abdd-3859ccadc0fb', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:01:01.739959 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:01.751544 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:01.753157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:01.754649 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1a811696-d0f1-4ab7-9df1-897d25a79e7b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.612737 Aug 30 02:01:01.755432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 372/710] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:01 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:01:02.155163 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:01:02.156142 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:01:02.157441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:01:02.157848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:01:02.158251 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:01:02.171465 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:02.172104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:02.172573 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:02.173838 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:02.174308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:02.174717 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:02.197722 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Getting quotas for project 4d07d38e84224c9282dea262e712e4e3. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:01:02.204078 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Getting quotas for user 0646d81951fa4353bdfb59048b498652 and project 4d07d38e84224c9282dea262e712e4e3. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:01:02.218196 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:01:02.223386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:01:02.292375 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e4b7b939-fffc-417e-b01e-17b314567dfa tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870171 Aug 30 02:01:02.293315 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 339/711] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 02:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:01:02.307297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b34d7257-abf7-474c-83e5-a593ba0a3550 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:02.308673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b34d7257-abf7-474c-83e5-a593ba0a3550 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:02.419085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b34d7257-abf7-474c-83e5-a593ba0a3550 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:02.426175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b34d7257-abf7-474c-83e5-a593ba0a3550 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1218 microversion: 2.1 time: 0.122823 Aug 30 02:01:02.430578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 373/712] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:02 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:02.449792 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-387fdc20-e562-443d-80fb-367c1b5c12c8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:02.450411 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-387fdc20-e562-443d-80fb-367c1b5c12c8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:02.458442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-387fdc20-e562-443d-80fb-367c1b5c12c8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:02.458442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-387fdc20-e562-443d-80fb-367c1b5c12c8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:02.458776 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-387fdc20-e562-443d-80fb-367c1b5c12c8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:02.459824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-387fdc20-e562-443d-80fb-367c1b5c12c8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:02.460661 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-387fdc20-e562-443d-80fb-367c1b5c12c8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:02.461283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-387fdc20-e562-443d-80fb-367c1b5c12c8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:02.743120 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-387fdc20-e562-443d-80fb-367c1b5c12c8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:02.757560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-387fdc20-e562-443d-80fb-367c1b5c12c8 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.312562 Aug 30 02:01:02.770090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 340/713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:02 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:02.788848 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:02.791039 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:02.806058 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:02.807156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:02.807776 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:02.808740 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:02.809372 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:02.810136 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:03.105761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:03.124983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:03.126325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:03.128200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-27b1e369-4c79-4668-8d46-98d41168301c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.343855 Aug 30 02:01:03.145419 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 374/714] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:02 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:03.450938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2541985c-6101-4433-84f8-ec08a80984ea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:03.452208 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2541985c-6101-4433-84f8-ec08a80984ea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:03.459493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2541985c-6101-4433-84f8-ec08a80984ea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:03.460745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2541985c-6101-4433-84f8-ec08a80984ea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:03.461745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2541985c-6101-4433-84f8-ec08a80984ea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:03.462444 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2541985c-6101-4433-84f8-ec08a80984ea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:03.463064 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2541985c-6101-4433-84f8-ec08a80984ea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:03.463514 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2541985c-6101-4433-84f8-ec08a80984ea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:03.547814 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2541985c-6101-4433-84f8-ec08a80984ea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:03.557727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2541985c-6101-4433-84f8-ec08a80984ea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.110533 Aug 30 02:01:03.564463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 341/715] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:03 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:03.795485 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-dbaadf0b-4069-4ceb-9a3b-b8cb43db2cee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:03.796161 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-dbaadf0b-4069-4ceb-9a3b-b8cb43db2cee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:03.802943 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbaadf0b-4069-4ceb-9a3b-b8cb43db2cee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:03.803368 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbaadf0b-4069-4ceb-9a3b-b8cb43db2cee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:03.803801 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbaadf0b-4069-4ceb-9a3b-b8cb43db2cee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:03.804574 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbaadf0b-4069-4ceb-9a3b-b8cb43db2cee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:03.805363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbaadf0b-4069-4ceb-9a3b-b8cb43db2cee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:03.806045 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dbaadf0b-4069-4ceb-9a3b-b8cb43db2cee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:04.041774 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-dbaadf0b-4069-4ceb-9a3b-b8cb43db2cee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:04.052721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-dbaadf0b-4069-4ceb-9a3b-b8cb43db2cee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.261493 Aug 30 02:01:04.054018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 375/716] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:03 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:04.154511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:04.155274 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:04.169473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:04.174693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:04.177343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:04.181037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:04.183264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:04.184101 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:04.476557 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:04.499670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:04.501657 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:04.503116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e7f00353-c28e-4280-8863-905f550eeb47 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.353027 Aug 30 02:01:04.504189 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 342/717] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:04 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:04.579398 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a1233a18-47c9-4fc9-abef-5e318e9cf414 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:04.580567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a1233a18-47c9-4fc9-abef-5e318e9cf414 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:04.587435 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1233a18-47c9-4fc9-abef-5e318e9cf414 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:04.588357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1233a18-47c9-4fc9-abef-5e318e9cf414 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:04.588975 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1233a18-47c9-4fc9-abef-5e318e9cf414 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:04.589877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1233a18-47c9-4fc9-abef-5e318e9cf414 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:04.590474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1233a18-47c9-4fc9-abef-5e318e9cf414 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:04.590898 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a1233a18-47c9-4fc9-abef-5e318e9cf414 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:04.684755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a1233a18-47c9-4fc9-abef-5e318e9cf414 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:04.705615 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a1233a18-47c9-4fc9-abef-5e318e9cf414 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.129228 Aug 30 02:01:04.729081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 376/718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:04 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:05.076040 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d5463eef-28c4-4782-b114-f92fe931424a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:05.077110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d5463eef-28c4-4782-b114-f92fe931424a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:05.089998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5463eef-28c4-4782-b114-f92fe931424a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:05.090511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5463eef-28c4-4782-b114-f92fe931424a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:05.090946 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5463eef-28c4-4782-b114-f92fe931424a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:05.091657 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5463eef-28c4-4782-b114-f92fe931424a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:05.092116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5463eef-28c4-4782-b114-f92fe931424a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:05.092568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d5463eef-28c4-4782-b114-f92fe931424a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:05.339958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d5463eef-28c4-4782-b114-f92fe931424a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:05.349771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d5463eef-28c4-4782-b114-f92fe931424a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.278844 Aug 30 02:01:05.350900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 343/719] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:05 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:05.544402 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:05.545193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:05.562776 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:05.563273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:05.563706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:05.564506 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:05.564959 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:05.565380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:05.746964 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-69acde49-4377-4125-894d-5fc687c9cf10 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:05.747597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-69acde49-4377-4125-894d-5fc687c9cf10 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:05.764745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-69acde49-4377-4125-894d-5fc687c9cf10 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:05.765238 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-69acde49-4377-4125-894d-5fc687c9cf10 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:05.767847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-69acde49-4377-4125-894d-5fc687c9cf10 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:05.768773 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-69acde49-4377-4125-894d-5fc687c9cf10 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:05.780212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-69acde49-4377-4125-894d-5fc687c9cf10 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:05.782456 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-69acde49-4377-4125-894d-5fc687c9cf10 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:05.898822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-69acde49-4377-4125-894d-5fc687c9cf10 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:05.911560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-69acde49-4377-4125-894d-5fc687c9cf10 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.176823 Aug 30 02:01:05.915603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 344/720] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:05 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:06.371056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f93b411f-d373-42b7-bcb7-57726a8c8fef tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:06.371668 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f93b411f-d373-42b7-bcb7-57726a8c8fef tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:06.378328 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f93b411f-d373-42b7-bcb7-57726a8c8fef tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:06.378816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f93b411f-d373-42b7-bcb7-57726a8c8fef tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:06.379250 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f93b411f-d373-42b7-bcb7-57726a8c8fef tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:06.379975 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f93b411f-d373-42b7-bcb7-57726a8c8fef tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:06.380454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f93b411f-d373-42b7-bcb7-57726a8c8fef tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:06.381129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f93b411f-d373-42b7-bcb7-57726a8c8fef tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:06.422026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:06.436341 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:06.443601 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:06.446938 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4c3dbc0e-bca0-4cdf-8068-fba935658541 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.921769 Aug 30 02:01:06.449412 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 377/721] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:05 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:06.624102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f93b411f-d373-42b7-bcb7-57726a8c8fef tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:06.634372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f93b411f-d373-42b7-bcb7-57726a8c8fef tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.267141 Aug 30 02:01:06.637338 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 345/722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:06 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:06.939934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5a4e7c3a-a4dc-4245-a1e1-9aacf024264d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:06.941366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5a4e7c3a-a4dc-4245-a1e1-9aacf024264d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:06.955551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a4e7c3a-a4dc-4245-a1e1-9aacf024264d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:06.956811 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a4e7c3a-a4dc-4245-a1e1-9aacf024264d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:06.961656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a4e7c3a-a4dc-4245-a1e1-9aacf024264d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:06.963450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a4e7c3a-a4dc-4245-a1e1-9aacf024264d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:06.964631 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a4e7c3a-a4dc-4245-a1e1-9aacf024264d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:06.965627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5a4e7c3a-a4dc-4245-a1e1-9aacf024264d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:07.079895 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5a4e7c3a-a4dc-4245-a1e1-9aacf024264d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:07.098261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5a4e7c3a-a4dc-4245-a1e1-9aacf024264d tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.164713 Aug 30 02:01:07.098849 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 378/723] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:06 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:07.474984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:07.476506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:07.486165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:07.487099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:07.487950 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:07.489898 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:07.491036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:07.492307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:07.659110 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-dd3180f3-af12-4716-868c-523a71182d9b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:07.660018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-dd3180f3-af12-4716-868c-523a71182d9b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:07.666819 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dd3180f3-af12-4716-868c-523a71182d9b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:07.667553 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dd3180f3-af12-4716-868c-523a71182d9b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:07.668397 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dd3180f3-af12-4716-868c-523a71182d9b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:07.669274 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dd3180f3-af12-4716-868c-523a71182d9b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:07.670008 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dd3180f3-af12-4716-868c-523a71182d9b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:07.670596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dd3180f3-af12-4716-868c-523a71182d9b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:07.697183 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:07.709330 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:07.710836 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:07.712614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6ed8d57a-5947-4fd0-a116-59aaba61b2a3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.242878 Aug 30 02:01:07.713151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 346/724] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:07 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:07.854786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-dd3180f3-af12-4716-868c-523a71182d9b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:07.864716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-dd3180f3-af12-4716-868c-523a71182d9b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.211252 Aug 30 02:01:07.866827 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 379/725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:07 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:08.122821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e0124da3-df32-42af-99be-0ad4f3017006 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:08.123450 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e0124da3-df32-42af-99be-0ad4f3017006 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:08.139618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0124da3-df32-42af-99be-0ad4f3017006 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:08.140285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0124da3-df32-42af-99be-0ad4f3017006 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:08.140851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0124da3-df32-42af-99be-0ad4f3017006 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:08.141627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0124da3-df32-42af-99be-0ad4f3017006 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:08.142151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0124da3-df32-42af-99be-0ad4f3017006 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:08.142817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e0124da3-df32-42af-99be-0ad4f3017006 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:08.250323 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e0124da3-df32-42af-99be-0ad4f3017006 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:08.263262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e0124da3-df32-42af-99be-0ad4f3017006 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.146719 Aug 30 02:01:08.264083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 347/726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:08 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:08.746685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:08.747463 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:08.758654 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:08.759389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:08.760005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:08.760962 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:08.761576 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:08.762158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:08.920922 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:08.931418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:08.932910 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:08.934100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8bddb95e-9135-4faf-bec1-d40401f6cca1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.195335 Aug 30 02:01:08.934654 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 380/727] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:08 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:08.939015 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-41d67deb-0424-4e24-9873-514c22fa77eb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:08.939610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-41d67deb-0424-4e24-9873-514c22fa77eb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:08.945933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41d67deb-0424-4e24-9873-514c22fa77eb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:08.946416 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41d67deb-0424-4e24-9873-514c22fa77eb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:08.946856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41d67deb-0424-4e24-9873-514c22fa77eb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:08.947543 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41d67deb-0424-4e24-9873-514c22fa77eb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:08.947993 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41d67deb-0424-4e24-9873-514c22fa77eb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:08.948447 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41d67deb-0424-4e24-9873-514c22fa77eb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:09.084488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-350ee927-f87c-47bf-b863-2be7d97699c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Action: 'create', calling method: .version_select at 0x7f3b0806b040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2051291069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHh6LDJc9TIiImF+ivubA2hC+/7axb9+jWhHBcTm278sin/CEStcbqznCudhWJ4ZwKBcmnDEt1FiPw13vFODcZ3b8kqgFQXszMuJss1oXKEDvmgt/siQIGpZkfUox/hiIg=="}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:09.122490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-350ee927-f87c-47bf-b863-2be7d97699c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Getting quotas for project 74610e8b7b4d4fafa0e49ba73b94aa48. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:01:09.130250 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-350ee927-f87c-47bf-b863-2be7d97699c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Getting quotas for user bd08361520db465bb9069326d03d0307 and project 74610e8b7b4d4fafa0e49ba73b94aa48. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:01:09.183066 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-350ee927-f87c-47bf-b863-2be7d97699c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.332124 Aug 30 02:01:09.189304 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 348/728] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 02:01:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:01:09.191084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-41d67deb-0424-4e24-9873-514c22fa77eb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:09.205143 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-41d67deb-0424-4e24-9873-514c22fa77eb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.266431 Aug 30 02:01:09.206038 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 381/729] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:08 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:09.285149 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4f57eac2-545c-4d3b-9166-1044a792312a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:09.287063 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4f57eac2-545c-4d3b-9166-1044a792312a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:09.290680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:09.310460 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f57eac2-545c-4d3b-9166-1044a792312a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:09.311671 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f57eac2-545c-4d3b-9166-1044a792312a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:09.312602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f57eac2-545c-4d3b-9166-1044a792312a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:09.313781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f57eac2-545c-4d3b-9166-1044a792312a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:09.314655 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f57eac2-545c-4d3b-9166-1044a792312a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:09.315283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f57eac2-545c-4d3b-9166-1044a792312a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:09.435951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4f57eac2-545c-4d3b-9166-1044a792312a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:09.452781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4f57eac2-545c-4d3b-9166-1044a792312a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.171695 Aug 30 02:01:09.454602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 349/730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:09 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:09.965072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:09.966524 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:09.978255 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:09.979079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:09.979985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:09.980929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:09.981571 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:09.982180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:10.203869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:10.213713 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:10.215628 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:10.217169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-62ef316b-8e1d-409f-bb94-693e9bd37ed4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.263370 Aug 30 02:01:10.238831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 382/731] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:09 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:10.242494 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-92acf026-ed95-4380-a4f5-a7369900d049 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:10.243162 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-92acf026-ed95-4380-a4f5-a7369900d049 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:10.263820 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92acf026-ed95-4380-a4f5-a7369900d049 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:10.264607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92acf026-ed95-4380-a4f5-a7369900d049 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:10.264774 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92acf026-ed95-4380-a4f5-a7369900d049 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:10.265487 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92acf026-ed95-4380-a4f5-a7369900d049 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:10.265943 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92acf026-ed95-4380-a4f5-a7369900d049 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:10.266364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92acf026-ed95-4380-a4f5-a7369900d049 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:10.474517 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8fda5156-ac70-49be-a7e8-44e0d3a150c9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:10.476735 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8fda5156-ac70-49be-a7e8-44e0d3a150c9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:10.486042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-92acf026-ed95-4380-a4f5-a7369900d049 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:10.494062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:10.494758 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8fda5156-ac70-49be-a7e8-44e0d3a150c9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:10.498507 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8fda5156-ac70-49be-a7e8-44e0d3a150c9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:10.499237 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8fda5156-ac70-49be-a7e8-44e0d3a150c9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:10.499961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-92acf026-ed95-4380-a4f5-a7369900d049 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.262017 Aug 30 02:01:10.500939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8fda5156-ac70-49be-a7e8-44e0d3a150c9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:10.501371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 350/732] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:10 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:10.503290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8fda5156-ac70-49be-a7e8-44e0d3a150c9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:10.503728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8fda5156-ac70-49be-a7e8-44e0d3a150c9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:10.663016 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8fda5156-ac70-49be-a7e8-44e0d3a150c9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:10.674702 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8fda5156-ac70-49be-a7e8-44e0d3a150c9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.204413 Aug 30 02:01:10.675611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 383/733] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:10 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:11.271726 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:11.273309 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:11.304133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:11.304687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:11.305153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:11.305864 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:11.306325 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:11.306759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:11.499795 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:11.512600 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:11.514065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:11.515239 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f164f327-f99f-42fe-bfb2-aca4df8fe250 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.253854 Aug 30 02:01:11.515798 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 351/734] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:11 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:11.523588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d67f2ea5-e1b0-4717-a876-5f404d14b8df tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:11.524330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d67f2ea5-e1b0-4717-a876-5f404d14b8df tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:11.530878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d67f2ea5-e1b0-4717-a876-5f404d14b8df tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:11.531355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d67f2ea5-e1b0-4717-a876-5f404d14b8df tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:11.531786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d67f2ea5-e1b0-4717-a876-5f404d14b8df tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:11.532493 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d67f2ea5-e1b0-4717-a876-5f404d14b8df tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:11.532946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d67f2ea5-e1b0-4717-a876-5f404d14b8df tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:11.533362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d67f2ea5-e1b0-4717-a876-5f404d14b8df tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:11.668123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d67f2ea5-e1b0-4717-a876-5f404d14b8df tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:11.676671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d67f2ea5-e1b0-4717-a876-5f404d14b8df tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.156884 Aug 30 02:01:11.677330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 384/735] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:11 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:11.697091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-73e3052b-0dc8-48c8-a25c-41094503d1f6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:11.697777 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-73e3052b-0dc8-48c8-a25c-41094503d1f6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:11.703888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73e3052b-0dc8-48c8-a25c-41094503d1f6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:11.704396 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73e3052b-0dc8-48c8-a25c-41094503d1f6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:11.704821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73e3052b-0dc8-48c8-a25c-41094503d1f6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:11.705506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73e3052b-0dc8-48c8-a25c-41094503d1f6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:11.705979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73e3052b-0dc8-48c8-a25c-41094503d1f6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:11.706401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-73e3052b-0dc8-48c8-a25c-41094503d1f6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:11.771293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-73e3052b-0dc8-48c8-a25c-41094503d1f6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:11.787858 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-73e3052b-0dc8-48c8-a25c-41094503d1f6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.094882 Aug 30 02:01:11.788682 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 352/736] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:11 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:12.539795 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:12.540439 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:12.542517 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:12.548478 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:12.548964 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:12.549399 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:12.550100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:12.550556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:12.550981 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:12.690173 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:12.698640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-582c3fe4-6bf2-4418-adcc-0079e66c2ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:12.699443 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-582c3fe4-6bf2-4418-adcc-0079e66c2ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:12.700503 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:12.701535 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:12.701969 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:12.703345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6d5974cc-3a2e-44d0-b062-d8eb712f230b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.168394 Aug 30 02:01:12.704082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 385/737] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:12 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:12.708070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-582c3fe4-6bf2-4418-adcc-0079e66c2ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:12.708640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-582c3fe4-6bf2-4418-adcc-0079e66c2ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:12.709139 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-582c3fe4-6bf2-4418-adcc-0079e66c2ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:12.710025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-582c3fe4-6bf2-4418-adcc-0079e66c2ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:12.710537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-582c3fe4-6bf2-4418-adcc-0079e66c2ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:12.711763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-582c3fe4-6bf2-4418-adcc-0079e66c2ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:12.818998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-eadc060f-a436-41c2-a3bc-1fa1da894570 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:12.820135 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-eadc060f-a436-41c2-a3bc-1fa1da894570 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:12.827302 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eadc060f-a436-41c2-a3bc-1fa1da894570 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:12.828205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eadc060f-a436-41c2-a3bc-1fa1da894570 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:12.828854 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eadc060f-a436-41c2-a3bc-1fa1da894570 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:12.829757 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eadc060f-a436-41c2-a3bc-1fa1da894570 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:12.830360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eadc060f-a436-41c2-a3bc-1fa1da894570 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:12.830953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eadc060f-a436-41c2-a3bc-1fa1da894570 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:12.854131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:12.874399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-582c3fe4-6bf2-4418-adcc-0079e66c2ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:12.883409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-582c3fe4-6bf2-4418-adcc-0079e66c2ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.188465 Aug 30 02:01:12.897115 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 353/738] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:12 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:12.967141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-eadc060f-a436-41c2-a3bc-1fa1da894570 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:12.978774 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-eadc060f-a436-41c2-a3bc-1fa1da894570 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.169796 Aug 30 02:01:12.979728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 386/739] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:12 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:13.729747 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:13.730360 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:13.736985 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:13.737512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:13.737952 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:13.738655 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:13.739111 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:13.739566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:13.901271 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:13.905584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7dc1023f-eb14-4ea8-b1dd-d8b01f5a5ede tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:13.906230 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7dc1023f-eb14-4ea8-b1dd-d8b01f5a5ede tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:13.909873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:13.911463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:13.912672 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7558d9ab-8207-4747-bf16-ebc1e68f5ac6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.186931 Aug 30 02:01:13.912897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dc1023f-eb14-4ea8-b1dd-d8b01f5a5ede tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:13.913390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dc1023f-eb14-4ea8-b1dd-d8b01f5a5ede tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:13.913758 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 354/740] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:13 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:13.913884 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dc1023f-eb14-4ea8-b1dd-d8b01f5a5ede tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:13.914553 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dc1023f-eb14-4ea8-b1dd-d8b01f5a5ede tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:13.915016 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dc1023f-eb14-4ea8-b1dd-d8b01f5a5ede tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:13.915442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dc1023f-eb14-4ea8-b1dd-d8b01f5a5ede tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:14.001517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-00f412dc-8525-4ff7-ac3c-4fbf687256b6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:14.001938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-00f412dc-8525-4ff7-ac3c-4fbf687256b6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:14.014057 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00f412dc-8525-4ff7-ac3c-4fbf687256b6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:14.014548 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00f412dc-8525-4ff7-ac3c-4fbf687256b6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:14.016786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00f412dc-8525-4ff7-ac3c-4fbf687256b6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:14.017781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00f412dc-8525-4ff7-ac3c-4fbf687256b6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:14.018461 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00f412dc-8525-4ff7-ac3c-4fbf687256b6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:14.019297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00f412dc-8525-4ff7-ac3c-4fbf687256b6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:14.073264 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7dc1023f-eb14-4ea8-b1dd-d8b01f5a5ede tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:14.081708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7dc1023f-eb14-4ea8-b1dd-d8b01f5a5ede tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.179910 Aug 30 02:01:14.082597 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 387/741] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:13 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:14.087502 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-00f412dc-8525-4ff7-ac3c-4fbf687256b6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:14.095151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-00f412dc-8525-4ff7-ac3c-4fbf687256b6 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.098785 Aug 30 02:01:14.095921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 355/742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:13 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:14.937092 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:14.937689 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:14.944004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:14.944521 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:14.944953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:14.946155 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:14.946617 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:14.947040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:15.093444 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:15.102896 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:15.110775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-00a90474-98f3-439b-8a3d-44629cf770e9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:15.111542 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-00a90474-98f3-439b-8a3d-44629cf770e9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:15.115370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:15.117189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-63f4b53b-7997-4592-8adc-2829be61e191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.184043 Aug 30 02:01:15.117795 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 388/743] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:14 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:15.118800 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00a90474-98f3-439b-8a3d-44629cf770e9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:15.119291 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00a90474-98f3-439b-8a3d-44629cf770e9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:15.119906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00a90474-98f3-439b-8a3d-44629cf770e9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:15.120643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00a90474-98f3-439b-8a3d-44629cf770e9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:15.121095 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00a90474-98f3-439b-8a3d-44629cf770e9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:15.121688 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00a90474-98f3-439b-8a3d-44629cf770e9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:15.123106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b9e363b2-9879-4b2c-aa91-5a748ef05693 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:15.123711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b9e363b2-9879-4b2c-aa91-5a748ef05693 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:15.131660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9e363b2-9879-4b2c-aa91-5a748ef05693 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:15.132438 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9e363b2-9879-4b2c-aa91-5a748ef05693 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:15.133569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9e363b2-9879-4b2c-aa91-5a748ef05693 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:15.134434 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9e363b2-9879-4b2c-aa91-5a748ef05693 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:15.134884 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9e363b2-9879-4b2c-aa91-5a748ef05693 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:15.135304 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9e363b2-9879-4b2c-aa91-5a748ef05693 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:15.213525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b9e363b2-9879-4b2c-aa91-5a748ef05693 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:15.223389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b9e363b2-9879-4b2c-aa91-5a748ef05693 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.104581 Aug 30 02:01:15.231972 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 389/744] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:15 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:15.300576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-00a90474-98f3-439b-8a3d-44629cf770e9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:15.309682 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-00a90474-98f3-439b-8a3d-44629cf770e9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.202593 Aug 30 02:01:15.310413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 356/745] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:15 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:16.141172 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:16.141771 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:16.149074 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:16.149885 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:16.150593 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:16.151472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:16.152124 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:16.152995 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:16.245606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0127b61a-9de6-418c-8607-e30a2d677df8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:16.246761 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0127b61a-9de6-418c-8607-e30a2d677df8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:16.253733 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0127b61a-9de6-418c-8607-e30a2d677df8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:16.254214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0127b61a-9de6-418c-8607-e30a2d677df8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:16.254648 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0127b61a-9de6-418c-8607-e30a2d677df8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:16.255348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0127b61a-9de6-418c-8607-e30a2d677df8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:16.256224 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0127b61a-9de6-418c-8607-e30a2d677df8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:16.256670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0127b61a-9de6-418c-8607-e30a2d677df8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:16.295345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:16.307725 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:16.309271 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:16.310520 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b392dd72-42c1-4b71-a6cb-adfe019fbf5f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.173733 Aug 30 02:01:16.311177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 390/746] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:16 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:16.327802 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0127b61a-9de6-418c-8607-e30a2d677df8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:16.331360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9b95dd72-08be-412c-b898-817852935c01 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:16.332019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9b95dd72-08be-412c-b898-817852935c01 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:16.335739 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0127b61a-9de6-418c-8607-e30a2d677df8 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.095080 Aug 30 02:01:16.336378 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 357/747] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:16 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:16.338456 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b95dd72-08be-412c-b898-817852935c01 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:16.338934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b95dd72-08be-412c-b898-817852935c01 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:16.339362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b95dd72-08be-412c-b898-817852935c01 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:16.340052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b95dd72-08be-412c-b898-817852935c01 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:16.340534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b95dd72-08be-412c-b898-817852935c01 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:16.340955 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b95dd72-08be-412c-b898-817852935c01 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:16.477977 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9b95dd72-08be-412c-b898-817852935c01 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:16.486121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9b95dd72-08be-412c-b898-817852935c01 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.159017 Aug 30 02:01:16.486681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 391/748] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:16 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:17.333755 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:17.334353 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:17.341350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:17.341828 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:17.342253 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:17.342934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:17.343380 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:17.343797 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:17.356532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-111a242c-359d-418c-b973-f985b9fe6a0c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:17.357827 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-111a242c-359d-418c-b973-f985b9fe6a0c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:17.364836 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-111a242c-359d-418c-b973-f985b9fe6a0c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:17.365877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-111a242c-359d-418c-b973-f985b9fe6a0c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:17.366317 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-111a242c-359d-418c-b973-f985b9fe6a0c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:17.367191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-111a242c-359d-418c-b973-f985b9fe6a0c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:17.367862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-111a242c-359d-418c-b973-f985b9fe6a0c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:17.368315 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-111a242c-359d-418c-b973-f985b9fe6a0c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:17.441308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-111a242c-359d-418c-b973-f985b9fe6a0c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:17.453263 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-111a242c-359d-418c-b973-f985b9fe6a0c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.100675 Aug 30 02:01:17.454223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 392/749] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:17 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:17.490728 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:17.500294 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:17.501936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:17.503649 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cafbbe61-ee6d-4963-a6e0-d9f7b9a203ac tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.173492 Aug 30 02:01:17.508578 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 358/750] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:17 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:17.510131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-06508ca9-5d03-4f99-8564-2e22971d272a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:17.510740 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-06508ca9-5d03-4f99-8564-2e22971d272a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:17.517116 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06508ca9-5d03-4f99-8564-2e22971d272a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:17.517600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06508ca9-5d03-4f99-8564-2e22971d272a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:17.518031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06508ca9-5d03-4f99-8564-2e22971d272a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:17.518881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06508ca9-5d03-4f99-8564-2e22971d272a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:17.519333 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06508ca9-5d03-4f99-8564-2e22971d272a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:17.519753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06508ca9-5d03-4f99-8564-2e22971d272a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:17.653425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-06508ca9-5d03-4f99-8564-2e22971d272a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:17.666752 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-06508ca9-5d03-4f99-8564-2e22971d272a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.162251 Aug 30 02:01:17.680285 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 393/751] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:17 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:18.473363 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bd100ba7-faaf-41be-91e3-4bf140f3eccb tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:18.473944 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bd100ba7-faaf-41be-91e3-4bf140f3eccb tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:18.480254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd100ba7-faaf-41be-91e3-4bf140f3eccb tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:18.480748 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd100ba7-faaf-41be-91e3-4bf140f3eccb tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:18.481177 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd100ba7-faaf-41be-91e3-4bf140f3eccb tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:18.481856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd100ba7-faaf-41be-91e3-4bf140f3eccb tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:18.482301 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd100ba7-faaf-41be-91e3-4bf140f3eccb tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:18.482722 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bd100ba7-faaf-41be-91e3-4bf140f3eccb tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:18.527064 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:18.527704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:18.534092 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:18.534579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:18.535016 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:18.535710 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:18.536167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:18.536629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:18.543410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bd100ba7-faaf-41be-91e3-4bf140f3eccb tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:18.550847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bd100ba7-faaf-41be-91e3-4bf140f3eccb tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.081399 Aug 30 02:01:18.551402 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 359/752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:18 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:18.669560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:18.678200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:18.680284 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:18.681562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0821baa3-75c2-4e6d-8301-6275f44b447d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.158505 Aug 30 02:01:18.682121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 394/753] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:18 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:01:18.691940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9d6e2cef-49a2-42a5-b6da-034610657ec9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:18.692602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9d6e2cef-49a2-42a5-b6da-034610657ec9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:18.699886 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d6e2cef-49a2-42a5-b6da-034610657ec9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:18.700429 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d6e2cef-49a2-42a5-b6da-034610657ec9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:18.700862 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d6e2cef-49a2-42a5-b6da-034610657ec9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:18.701555 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d6e2cef-49a2-42a5-b6da-034610657ec9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:18.702017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d6e2cef-49a2-42a5-b6da-034610657ec9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:18.702439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9d6e2cef-49a2-42a5-b6da-034610657ec9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:18.837371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9d6e2cef-49a2-42a5-b6da-034610657ec9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:18.845867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9d6e2cef-49a2-42a5-b6da-034610657ec9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.160313 Aug 30 02:01:18.846439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 360/754] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:18 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:19.572334 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-37e38c1e-210f-4377-9bb8-083fab09f72a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:19.572865 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-37e38c1e-210f-4377-9bb8-083fab09f72a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:19.579248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37e38c1e-210f-4377-9bb8-083fab09f72a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:19.579723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37e38c1e-210f-4377-9bb8-083fab09f72a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:19.580146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37e38c1e-210f-4377-9bb8-083fab09f72a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:19.581127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37e38c1e-210f-4377-9bb8-083fab09f72a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:19.581577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37e38c1e-210f-4377-9bb8-083fab09f72a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:19.581992 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-37e38c1e-210f-4377-9bb8-083fab09f72a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:19.644500 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-37e38c1e-210f-4377-9bb8-083fab09f72a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:19.652808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-37e38c1e-210f-4377-9bb8-083fab09f72a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.084837 Aug 30 02:01:19.653371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 395/755] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:19 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:19.704096 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:19.704732 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:19.706564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=10 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:19.715052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:19.715538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:19.715974 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:19.716688 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:19.717142 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:19.717564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:19.849691 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:19.858105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:19.859537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:19.860758 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d45ee67a-0b76-4a92-9319-cfcc25b73dd8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.160683 Aug 30 02:01:19.861301 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 361/756] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:19 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:19.866773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-76d7bf3f-4469-4f08-a26b-f9ebbda7fca5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:19.867863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-76d7bf3f-4469-4f08-a26b-f9ebbda7fca5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:19.873635 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76d7bf3f-4469-4f08-a26b-f9ebbda7fca5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:19.874107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76d7bf3f-4469-4f08-a26b-f9ebbda7fca5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:19.874532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76d7bf3f-4469-4f08-a26b-f9ebbda7fca5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:19.875204 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76d7bf3f-4469-4f08-a26b-f9ebbda7fca5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:19.875648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76d7bf3f-4469-4f08-a26b-f9ebbda7fca5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:19.876062 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-76d7bf3f-4469-4f08-a26b-f9ebbda7fca5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:20.006290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-76d7bf3f-4469-4f08-a26b-f9ebbda7fca5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:20.015424 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-76d7bf3f-4469-4f08-a26b-f9ebbda7fca5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.152344 Aug 30 02:01:20.016008 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 396/757] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:19 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:20.673016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-509ed8b1-7e7d-4914-894f-bfa56aeb653f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:20.673940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-509ed8b1-7e7d-4914-894f-bfa56aeb653f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:20.684270 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-509ed8b1-7e7d-4914-894f-bfa56aeb653f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:20.684858 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-509ed8b1-7e7d-4914-894f-bfa56aeb653f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:20.685296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-509ed8b1-7e7d-4914-894f-bfa56aeb653f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:20.685997 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-509ed8b1-7e7d-4914-894f-bfa56aeb653f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:20.686443 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-509ed8b1-7e7d-4914-894f-bfa56aeb653f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:20.686863 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-509ed8b1-7e7d-4914-894f-bfa56aeb653f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:20.746994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-509ed8b1-7e7d-4914-894f-bfa56aeb653f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:20.754723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-509ed8b1-7e7d-4914-894f-bfa56aeb653f tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1222 microversion: 2.1 time: 0.085654 Aug 30 02:01:20.755660 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 362/758] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:20 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:20.883630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:20.884304 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:20.890666 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:20.891121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:20.891554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:20.892258 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:20.892709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:20.893125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:21.021919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:21.031909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:21.033472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:21.034727 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9f08a73b-1cbb-47ce-8e98-3a016b6cac18 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.155399 Aug 30 02:01:21.035280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 397/759] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:20 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:21.037479 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-35cb21e5-f113-461f-a9ba-3d3eb8e08f97 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:21.038086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-35cb21e5-f113-461f-a9ba-3d3eb8e08f97 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:21.044724 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35cb21e5-f113-461f-a9ba-3d3eb8e08f97 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:21.045209 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35cb21e5-f113-461f-a9ba-3d3eb8e08f97 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:21.045640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35cb21e5-f113-461f-a9ba-3d3eb8e08f97 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:21.046326 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35cb21e5-f113-461f-a9ba-3d3eb8e08f97 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:21.046776 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35cb21e5-f113-461f-a9ba-3d3eb8e08f97 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:21.047200 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-35cb21e5-f113-461f-a9ba-3d3eb8e08f97 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:21.177117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-35cb21e5-f113-461f-a9ba-3d3eb8e08f97 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:21.185251 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-35cb21e5-f113-461f-a9ba-3d3eb8e08f97 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1699 microversion: 2.1 time: 0.152216 Aug 30 02:01:21.185812 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 363/760] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:21 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:21.205305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-47ff99fa-ac3e-49c4-a1cd-0bc612ca5654 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:21.212070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47ff99fa-ac3e-49c4-a1cd-0bc612ca5654 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:21.212582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47ff99fa-ac3e-49c4-a1cd-0bc612ca5654 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:21.213010 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47ff99fa-ac3e-49c4-a1cd-0bc612ca5654 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:21.271602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-47ff99fa-ac3e-49c4-a1cd-0bc612ca5654 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Going to try to start instance {{(pid=120391) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 02:01:21.317014 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-47ff99fa-ac3e-49c4-a1cd-0bc612ca5654 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/action" status: 202 len: 0 microversion: 2.1 time: 0.115302 Aug 30 02:01:21.317613 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 398/761] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:01:21 2022] POST /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:01:21.325727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d7992ebc-7d7a-4717-82e2-d3c6f9f7fd8b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:21.326335 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d7992ebc-7d7a-4717-82e2-d3c6f9f7fd8b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:21.332319 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7992ebc-7d7a-4717-82e2-d3c6f9f7fd8b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:21.332809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7992ebc-7d7a-4717-82e2-d3c6f9f7fd8b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:21.333241 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7992ebc-7d7a-4717-82e2-d3c6f9f7fd8b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:21.333926 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7992ebc-7d7a-4717-82e2-d3c6f9f7fd8b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:21.334377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7992ebc-7d7a-4717-82e2-d3c6f9f7fd8b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:21.334800 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d7992ebc-7d7a-4717-82e2-d3c6f9f7fd8b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:21.462214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d7992ebc-7d7a-4717-82e2-d3c6f9f7fd8b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:21.470663 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d7992ebc-7d7a-4717-82e2-d3c6f9f7fd8b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1708 microversion: 2.1 time: 0.148609 Aug 30 02:01:21.471239 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 364/762] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:21 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:21.783588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7d9d1aa4-b27f-4c1c-a7af-5bc20735b160 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:21.784307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7d9d1aa4-b27f-4c1c-a7af-5bc20735b160 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:21.790513 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9d1aa4-b27f-4c1c-a7af-5bc20735b160 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:21.790988 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9d1aa4-b27f-4c1c-a7af-5bc20735b160 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:21.791421 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9d1aa4-b27f-4c1c-a7af-5bc20735b160 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:21.792106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9d1aa4-b27f-4c1c-a7af-5bc20735b160 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:21.792589 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9d1aa4-b27f-4c1c-a7af-5bc20735b160 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:21.793011 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9d1aa4-b27f-4c1c-a7af-5bc20735b160 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:21.870643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7d9d1aa4-b27f-4c1c-a7af-5bc20735b160 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:21.877181 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7d9d1aa4-b27f-4c1c-a7af-5bc20735b160 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1214 microversion: 2.1 time: 0.102214 Aug 30 02:01:21.877765 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 399/763] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:21 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:22.057867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:22.058398 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:22.065138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:22.065625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:22.066056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:22.066804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:22.067250 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:22.067667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:22.200080 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:22.209342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:22.210976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:22.212338 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b2abcf35-f2f3-499a-9102-ddd5988a157f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.159058 Aug 30 02:01:22.212935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 365/764] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:22 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:22.492122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-12110e31-6639-4423-ad83-0a94944cbf13 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:22.493417 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-12110e31-6639-4423-ad83-0a94944cbf13 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:22.507566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12110e31-6639-4423-ad83-0a94944cbf13 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:22.508046 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12110e31-6639-4423-ad83-0a94944cbf13 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:22.508514 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12110e31-6639-4423-ad83-0a94944cbf13 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:22.509206 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12110e31-6639-4423-ad83-0a94944cbf13 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:22.509656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12110e31-6639-4423-ad83-0a94944cbf13 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:22.510129 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-12110e31-6639-4423-ad83-0a94944cbf13 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:22.641051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-12110e31-6639-4423-ad83-0a94944cbf13 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:22.649963 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-12110e31-6639-4423-ad83-0a94944cbf13 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1708 microversion: 2.1 time: 0.161841 Aug 30 02:01:22.650536 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 400/765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:22 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:22.897993 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c6d56f0e-af3c-4656-99ed-ac54123f6fc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:22.899014 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c6d56f0e-af3c-4656-99ed-ac54123f6fc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:22.905426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6d56f0e-af3c-4656-99ed-ac54123f6fc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:22.905924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6d56f0e-af3c-4656-99ed-ac54123f6fc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:22.906355 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6d56f0e-af3c-4656-99ed-ac54123f6fc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:22.907145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6d56f0e-af3c-4656-99ed-ac54123f6fc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:22.907600 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6d56f0e-af3c-4656-99ed-ac54123f6fc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:22.908030 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6d56f0e-af3c-4656-99ed-ac54123f6fc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:22.969448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c6d56f0e-af3c-4656-99ed-ac54123f6fc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:22.977980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c6d56f0e-af3c-4656-99ed-ac54123f6fc9 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1214 microversion: 2.1 time: 0.083945 Aug 30 02:01:22.978536 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 366/766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:22 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:23.235214 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:23.235827 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:23.242913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:23.244117 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:23.244593 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:23.245310 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:23.245764 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:23.246191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:23.407576 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:23.410167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:23.418544 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:23.420082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:23.421374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a5c25a8f-909e-4b59-a6d9-de0079e6ccf4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.190224 Aug 30 02:01:23.422203 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 401/767] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:23 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:23.670970 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3a9d8dd3-3376-4be1-bee8-b6d8efcd2503 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:23.671706 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3a9d8dd3-3376-4be1-bee8-b6d8efcd2503 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:23.679254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a9d8dd3-3376-4be1-bee8-b6d8efcd2503 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:23.680497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a9d8dd3-3376-4be1-bee8-b6d8efcd2503 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:23.681201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a9d8dd3-3376-4be1-bee8-b6d8efcd2503 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:23.682076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a9d8dd3-3376-4be1-bee8-b6d8efcd2503 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:23.682827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a9d8dd3-3376-4be1-bee8-b6d8efcd2503 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:23.683262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a9d8dd3-3376-4be1-bee8-b6d8efcd2503 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:23.702417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:23.824878 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3a9d8dd3-3376-4be1-bee8-b6d8efcd2503 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:23.833555 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3a9d8dd3-3376-4be1-bee8-b6d8efcd2503 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1708 microversion: 2.1 time: 0.166470 Aug 30 02:01:23.834133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 367/768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:23 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1708 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:24.000225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-75ede0d7-7797-4186-85e7-4fefc3d54263 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:24.001404 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-75ede0d7-7797-4186-85e7-4fefc3d54263 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:24.009709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ede0d7-7797-4186-85e7-4fefc3d54263 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:24.010184 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ede0d7-7797-4186-85e7-4fefc3d54263 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:24.010617 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ede0d7-7797-4186-85e7-4fefc3d54263 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:24.011285 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ede0d7-7797-4186-85e7-4fefc3d54263 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:24.011728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ede0d7-7797-4186-85e7-4fefc3d54263 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:24.012144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-75ede0d7-7797-4186-85e7-4fefc3d54263 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:24.072628 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-75ede0d7-7797-4186-85e7-4fefc3d54263 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:24.080107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-75ede0d7-7797-4186-85e7-4fefc3d54263 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1270 microversion: 2.1 time: 0.083987 Aug 30 02:01:24.080727 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 402/769] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:23 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:24.447804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:24.448467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:24.454348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:24.454820 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:24.455244 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:24.455918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:24.456405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:24.456821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:24.584913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:24.596963 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:24.597711 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:24.598873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-904e9cc2-3cc3-4b8c-a688-95020c5894d0 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.155257 Aug 30 02:01:24.599572 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 368/770] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:24 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:24.854749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c20d3497-7e26-47c6-ba00-973179e655c9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:24.855613 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c20d3497-7e26-47c6-ba00-973179e655c9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:24.858505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=78 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:24.862654 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c20d3497-7e26-47c6-ba00-973179e655c9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:24.863133 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c20d3497-7e26-47c6-ba00-973179e655c9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:24.863565 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c20d3497-7e26-47c6-ba00-973179e655c9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:24.864272 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c20d3497-7e26-47c6-ba00-973179e655c9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:24.864734 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c20d3497-7e26-47c6-ba00-973179e655c9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:24.865199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c20d3497-7e26-47c6-ba00-973179e655c9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:25.081102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c20d3497-7e26-47c6-ba00-973179e655c9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:25.089620 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c20d3497-7e26-47c6-ba00-973179e655c9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1708 microversion: 2.1 time: 0.238707 Aug 30 02:01:25.090121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 403/771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:24 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1708 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:25.099729 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b13287b1-2417-43e5-b29a-484b4586518a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:25.100479 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b13287b1-2417-43e5-b29a-484b4586518a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:25.107049 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13287b1-2417-43e5-b29a-484b4586518a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:25.107527 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13287b1-2417-43e5-b29a-484b4586518a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:25.108937 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13287b1-2417-43e5-b29a-484b4586518a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:25.109667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13287b1-2417-43e5-b29a-484b4586518a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:25.110120 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13287b1-2417-43e5-b29a-484b4586518a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:25.110541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b13287b1-2417-43e5-b29a-484b4586518a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:25.266154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b13287b1-2417-43e5-b29a-484b4586518a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:25.274169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b13287b1-2417-43e5-b29a-484b4586518a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.178193 Aug 30 02:01:25.274724 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 369/772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:25 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:25.623551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:25.624140 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:25.630123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:25.630590 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:25.631724 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:25.632528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:25.633016 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:25.633474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:25.779283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:25.789539 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:25.791079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:25.792647 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-568b5ff0-6f44-468d-a072-ca6d2cc64dea tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.172848 Aug 30 02:01:25.793066 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 404/773] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:25 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:26.109622 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d67ead17-3d84-489c-a2ef-e7a2ed48f814 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:26.110247 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d67ead17-3d84-489c-a2ef-e7a2ed48f814 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:26.117161 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d67ead17-3d84-489c-a2ef-e7a2ed48f814 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:26.117647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d67ead17-3d84-489c-a2ef-e7a2ed48f814 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:26.118082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d67ead17-3d84-489c-a2ef-e7a2ed48f814 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:26.118768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d67ead17-3d84-489c-a2ef-e7a2ed48f814 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:26.119218 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d67ead17-3d84-489c-a2ef-e7a2ed48f814 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:26.119638 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d67ead17-3d84-489c-a2ef-e7a2ed48f814 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:26.251434 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d67ead17-3d84-489c-a2ef-e7a2ed48f814 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:26.260466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d67ead17-3d84-489c-a2ef-e7a2ed48f814 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1712 microversion: 2.1 time: 0.154744 Aug 30 02:01:26.261036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 370/774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:26 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1712 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:26.294901 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bcc5b0e1-0efd-439f-9ab5-8150f04be8a2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:26.295990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bcc5b0e1-0efd-439f-9ab5-8150f04be8a2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:26.303564 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc5b0e1-0efd-439f-9ab5-8150f04be8a2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:26.304220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc5b0e1-0efd-439f-9ab5-8150f04be8a2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:26.304970 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc5b0e1-0efd-439f-9ab5-8150f04be8a2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:26.305685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc5b0e1-0efd-439f-9ab5-8150f04be8a2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:26.306164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc5b0e1-0efd-439f-9ab5-8150f04be8a2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:26.306668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bcc5b0e1-0efd-439f-9ab5-8150f04be8a2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:26.382042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-5f1db912-cc66-40ac-ab68-85df5a88f8d6 req-07140a7e-e357-41ef-bd11-9d5af2cdf2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65eab266-f475-47c5-98a1-070a67ff8e68", "tag": "eb2a3763-3850-42a6-8a5c-6dde5552ec37"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:26.391733 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5f1db912-cc66-40ac-ab68-85df5a88f8d6 req-07140a7e-e357-41ef-bd11-9d5af2cdf2b3 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:26.392219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5f1db912-cc66-40ac-ab68-85df5a88f8d6 req-07140a7e-e357-41ef-bd11-9d5af2cdf2b3 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:26.392667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5f1db912-cc66-40ac-ab68-85df5a88f8d6 req-07140a7e-e357-41ef-bd11-9d5af2cdf2b3 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:26.403947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-5f1db912-cc66-40ac-ab68-85df5a88f8d6 req-07140a7e-e357-41ef-bd11-9d5af2cdf2b3 service nova] Creating event network-changed:eb2a3763-3850-42a6-8a5c-6dde5552ec37 for instance 65eab266-f475-47c5-98a1-070a67ff8e68 on hv-cinder-81966 Aug 30 02:01:26.408779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-5f1db912-cc66-40ac-ab68-85df5a88f8d6 req-07140a7e-e357-41ef-bd11-9d5af2cdf2b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089679 Aug 30 02:01:26.409364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 371/775] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:01:26.466861 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-bcc5b0e1-0efd-439f-9ab5-8150f04be8a2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:26.475063 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bcc5b0e1-0efd-439f-9ab5-8150f04be8a2 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.183997 Aug 30 02:01:26.475633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 405/776] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:26 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:26.816925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:26.817635 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:26.824111 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:26.824621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:26.825051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:26.825739 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:26.826203 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:26.826609 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:26.962217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:26.970770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:26.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:26.973416 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-37dd96a6-6c19-44b4-b54a-e2cb3ed211db tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.162205 Aug 30 02:01:26.973972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 372/777] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:26 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:27.494426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4ccf098e-95da-45b4-8ee9-31c37ed0ec54 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:27.495023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4ccf098e-95da-45b4-8ee9-31c37ed0ec54 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:27.501405 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ccf098e-95da-45b4-8ee9-31c37ed0ec54 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:27.501874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ccf098e-95da-45b4-8ee9-31c37ed0ec54 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:27.502299 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ccf098e-95da-45b4-8ee9-31c37ed0ec54 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:27.502972 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ccf098e-95da-45b4-8ee9-31c37ed0ec54 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:27.503412 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ccf098e-95da-45b4-8ee9-31c37ed0ec54 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:27.503826 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4ccf098e-95da-45b4-8ee9-31c37ed0ec54 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:27.629218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4ccf098e-95da-45b4-8ee9-31c37ed0ec54 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:27.637397 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4ccf098e-95da-45b4-8ee9-31c37ed0ec54 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.146822 Aug 30 02:01:27.637951 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 406/778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:27 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:27.997287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:27.997900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:28.004368 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:28.004854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:28.005326 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:28.006288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:28.006752 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:28.007177 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:28.130230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:28.144854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:28.146295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:28.147460 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-db029fca-34ba-45ee-8ad8-343644191163 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.154036 Aug 30 02:01:28.148016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 373/779] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:27 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:28.658112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-78f0d9c4-5034-4ccc-94b8-d0dd0a1da32c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:28.658640 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-78f0d9c4-5034-4ccc-94b8-d0dd0a1da32c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:28.665705 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78f0d9c4-5034-4ccc-94b8-d0dd0a1da32c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:28.666205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78f0d9c4-5034-4ccc-94b8-d0dd0a1da32c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:28.666626 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78f0d9c4-5034-4ccc-94b8-d0dd0a1da32c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:28.667298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78f0d9c4-5034-4ccc-94b8-d0dd0a1da32c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:28.667741 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78f0d9c4-5034-4ccc-94b8-d0dd0a1da32c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:28.668155 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78f0d9c4-5034-4ccc-94b8-d0dd0a1da32c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:28.794574 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-78f0d9c4-5034-4ccc-94b8-d0dd0a1da32c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:28.802042 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-78f0d9c4-5034-4ccc-94b8-d0dd0a1da32c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.147809 Aug 30 02:01:28.802593 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 407/780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:28 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:29.170490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:29.171133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:29.177565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:29.178047 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:29.178491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:29.179178 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:29.179631 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:29.180054 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:29.318445 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:29.327831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:29.329295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:29.330433 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-054aae50-395b-447c-b851-98ab09fae795 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.163843 Aug 30 02:01:29.330977 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 374/781] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:29 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:29.821984 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8de989cf-8086-4eed-843d-a9069ecd9e16 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:29.822596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8de989cf-8086-4eed-843d-a9069ecd9e16 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:29.829078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8de989cf-8086-4eed-843d-a9069ecd9e16 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:29.829552 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8de989cf-8086-4eed-843d-a9069ecd9e16 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:29.829983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8de989cf-8086-4eed-843d-a9069ecd9e16 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:29.830663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8de989cf-8086-4eed-843d-a9069ecd9e16 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:29.831111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8de989cf-8086-4eed-843d-a9069ecd9e16 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:29.831533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8de989cf-8086-4eed-843d-a9069ecd9e16 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:29.955537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8de989cf-8086-4eed-843d-a9069ecd9e16 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:29.963081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8de989cf-8086-4eed-843d-a9069ecd9e16 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.144996 Aug 30 02:01:29.963650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 408/782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:29 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:30.353397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:30.353993 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:30.360435 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:30.360912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:30.361337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:30.362013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:30.362456 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:30.362868 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:30.489277 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:30.497720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:30.499138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:30.500301 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-33e375f8-e62e-4b56-b895-9873a598f6c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.151348 Aug 30 02:01:30.500844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 375/783] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:30 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:30.983226 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1a1b318e-8c78-41c4-b200-25bbeb16a011 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:30.983826 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1a1b318e-8c78-41c4-b200-25bbeb16a011 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:30.990174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a1b318e-8c78-41c4-b200-25bbeb16a011 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:30.990643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a1b318e-8c78-41c4-b200-25bbeb16a011 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:30.991071 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a1b318e-8c78-41c4-b200-25bbeb16a011 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:30.991742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a1b318e-8c78-41c4-b200-25bbeb16a011 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:30.992772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a1b318e-8c78-41c4-b200-25bbeb16a011 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:30.993192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a1b318e-8c78-41c4-b200-25bbeb16a011 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:31.117554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1a1b318e-8c78-41c4-b200-25bbeb16a011 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:31.125000 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1a1b318e-8c78-41c4-b200-25bbeb16a011 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.145624 Aug 30 02:01:31.125551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 409/784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:30 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:31.523677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:31.524298 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:31.531194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:31.531704 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:31.532134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:31.532848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:31.533294 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:31.533712 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:31.665214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:31.673959 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:31.675504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:31.676693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a54bfc96-24f9-4b3c-92f9-037ee63be854 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.156999 Aug 30 02:01:31.677550 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 376/785] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:31 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:32.145927 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6aa64f02-5b16-4811-8382-7a3caf67663a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:32.146534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6aa64f02-5b16-4811-8382-7a3caf67663a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:32.153603 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6aa64f02-5b16-4811-8382-7a3caf67663a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:32.154074 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6aa64f02-5b16-4811-8382-7a3caf67663a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:32.154505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6aa64f02-5b16-4811-8382-7a3caf67663a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:32.155195 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6aa64f02-5b16-4811-8382-7a3caf67663a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:32.155640 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6aa64f02-5b16-4811-8382-7a3caf67663a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:32.156059 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6aa64f02-5b16-4811-8382-7a3caf67663a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:32.280603 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6aa64f02-5b16-4811-8382-7a3caf67663a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:32.288121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6aa64f02-5b16-4811-8382-7a3caf67663a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.145973 Aug 30 02:01:32.288764 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 410/786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:32 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:32.699965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:32.700590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:32.706992 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:32.707497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:32.707930 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:32.708637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:32.709085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:32.709506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:32.834434 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:32.843342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:32.844873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:32.846055 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d18912d3-87ab-4205-aee5-8e680e1f143c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.150703 Aug 30 02:01:32.846627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 377/787] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:32 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:33.309158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1543f4af-9b79-4c2f-b491-ffc595269527 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:33.309769 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1543f4af-9b79-4c2f-b491-ffc595269527 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:33.315747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1543f4af-9b79-4c2f-b491-ffc595269527 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:33.316228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1543f4af-9b79-4c2f-b491-ffc595269527 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:33.316696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1543f4af-9b79-4c2f-b491-ffc595269527 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:33.317386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1543f4af-9b79-4c2f-b491-ffc595269527 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:33.317864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1543f4af-9b79-4c2f-b491-ffc595269527 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:33.318294 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1543f4af-9b79-4c2f-b491-ffc595269527 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:33.445794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1543f4af-9b79-4c2f-b491-ffc595269527 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:33.453352 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1543f4af-9b79-4c2f-b491-ffc595269527 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.148822 Aug 30 02:01:33.453919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 411/788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:33 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:33.869227 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:33.869831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:33.876283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:33.876759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:33.877186 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:33.877860 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:33.878301 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:33.878715 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:34.006775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:34.015912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:34.017315 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:34.018463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-464f10ab-75f5-42a9-bae0-aa3b53a3e744 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.153065 Aug 30 02:01:34.019017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 378/789] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:33 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:34.474050 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bbf2b8f4-0f8d-4b22-bfaa-6a1b6a0d02fe tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:34.474652 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bbf2b8f4-0f8d-4b22-bfaa-6a1b6a0d02fe tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:34.481451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bbf2b8f4-0f8d-4b22-bfaa-6a1b6a0d02fe tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:34.481926 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bbf2b8f4-0f8d-4b22-bfaa-6a1b6a0d02fe tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:34.482354 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bbf2b8f4-0f8d-4b22-bfaa-6a1b6a0d02fe tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:34.483033 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bbf2b8f4-0f8d-4b22-bfaa-6a1b6a0d02fe tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:34.483482 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bbf2b8f4-0f8d-4b22-bfaa-6a1b6a0d02fe tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:34.483901 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bbf2b8f4-0f8d-4b22-bfaa-6a1b6a0d02fe tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:34.612851 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-bbf2b8f4-0f8d-4b22-bfaa-6a1b6a0d02fe tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:34.621079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bbf2b8f4-0f8d-4b22-bfaa-6a1b6a0d02fe tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.150801 Aug 30 02:01:34.621650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 412/790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:34 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:35.041765 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:35.042376 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:35.048923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:35.049406 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:35.049838 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:35.051012 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:35.051484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:35.051906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:35.185233 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:35.193759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:35.195434 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:35.196607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2c5be3ec-f608-4c2d-bf53-14612ac487e1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.159309 Aug 30 02:01:35.197158 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 379/791] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:35 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:35.642567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8a4ea303-35c3-4fba-846d-a48d62f55ad5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:35.643000 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8a4ea303-35c3-4fba-846d-a48d62f55ad5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:35.649948 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a4ea303-35c3-4fba-846d-a48d62f55ad5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:35.650448 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a4ea303-35c3-4fba-846d-a48d62f55ad5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:35.650863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a4ea303-35c3-4fba-846d-a48d62f55ad5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:35.651547 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a4ea303-35c3-4fba-846d-a48d62f55ad5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:35.651998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a4ea303-35c3-4fba-846d-a48d62f55ad5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:35.652450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a4ea303-35c3-4fba-846d-a48d62f55ad5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:35.806099 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8a4ea303-35c3-4fba-846d-a48d62f55ad5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:35.813691 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8a4ea303-35c3-4fba-846d-a48d62f55ad5 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.175092 Aug 30 02:01:35.814262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 413/792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:35 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:35.986767 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-9089f3c4-5cd0-4a0d-aa9c-a568f710d5d2 req-1d442be7-9c2f-44a9-acea-2ffccb2925ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65eab266-f475-47c5-98a1-070a67ff8e68", "name": "network-vif-plugged", "status": "completed", "tag": "eb2a3763-3850-42a6-8a5c-6dde5552ec37"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:35.997737 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-9089f3c4-5cd0-4a0d-aa9c-a568f710d5d2 req-1d442be7-9c2f-44a9-acea-2ffccb2925ad service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:35.998215 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-9089f3c4-5cd0-4a0d-aa9c-a568f710d5d2 req-1d442be7-9c2f-44a9-acea-2ffccb2925ad service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:35.998747 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-9089f3c4-5cd0-4a0d-aa9c-a568f710d5d2 req-1d442be7-9c2f-44a9-acea-2ffccb2925ad service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:36.010040 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-9089f3c4-5cd0-4a0d-aa9c-a568f710d5d2 req-1d442be7-9c2f-44a9-acea-2ffccb2925ad service nova] Creating event network-vif-plugged:eb2a3763-3850-42a6-8a5c-6dde5552ec37 for instance 65eab266-f475-47c5-98a1-070a67ff8e68 on hv-cinder-81966 Aug 30 02:01:36.015146 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-9089f3c4-5cd0-4a0d-aa9c-a568f710d5d2 req-1d442be7-9c2f-44a9-acea-2ffccb2925ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086383 Aug 30 02:01:36.015710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 380/793] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:01:36.219240 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:36.219846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:36.225697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:36.226175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:36.226602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:36.227286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:36.227733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:36.228154 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:36.374822 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:36.384601 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:36.386162 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:36.387398 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-16e74ba0-7d51-40e4-a75a-7404c06fb581 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.172071 Aug 30 02:01:36.388662 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 414/794] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:36 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:36.835309 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aeca4822-19b3-46c1-98de-de67c504b4d7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:36.836001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-aeca4822-19b3-46c1-98de-de67c504b4d7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:36.842571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aeca4822-19b3-46c1-98de-de67c504b4d7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:36.843042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aeca4822-19b3-46c1-98de-de67c504b4d7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:36.843469 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aeca4822-19b3-46c1-98de-de67c504b4d7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:36.844141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aeca4822-19b3-46c1-98de-de67c504b4d7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:36.844608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aeca4822-19b3-46c1-98de-de67c504b4d7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:36.845024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aeca4822-19b3-46c1-98de-de67c504b4d7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:36.974457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aeca4822-19b3-46c1-98de-de67c504b4d7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:36.982612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-aeca4822-19b3-46c1-98de-de67c504b4d7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.151439 Aug 30 02:01:36.983162 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 381/795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:36 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:37.411320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:37.411931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:37.418285 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:37.418764 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:37.419198 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:37.419882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:37.420375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:37.420799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:37.549443 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:37.557914 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:37.559345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:37.560532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a766317b-96d4-417a-ac83-0ad693e467e8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.153035 Aug 30 02:01:37.561080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 415/796] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:37 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:38.003028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9a346fcc-f800-43b2-a3f2-e0d178aa4bb4 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:38.003597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9a346fcc-f800-43b2-a3f2-e0d178aa4bb4 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:38.010992 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a346fcc-f800-43b2-a3f2-e0d178aa4bb4 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:38.011471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a346fcc-f800-43b2-a3f2-e0d178aa4bb4 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:38.011898 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a346fcc-f800-43b2-a3f2-e0d178aa4bb4 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:38.012642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a346fcc-f800-43b2-a3f2-e0d178aa4bb4 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:38.013092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a346fcc-f800-43b2-a3f2-e0d178aa4bb4 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:38.013514 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9a346fcc-f800-43b2-a3f2-e0d178aa4bb4 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:38.146027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9a346fcc-f800-43b2-a3f2-e0d178aa4bb4 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:38.153585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9a346fcc-f800-43b2-a3f2-e0d178aa4bb4 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.154522 Aug 30 02:01:38.154126 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 382/797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:37 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:38.583911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:38.584456 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:38.590852 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:38.591326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:38.591754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:38.592469 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:38.592917 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:38.593335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:38.717611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:38.726133 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:38.727577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:38.728787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-06b5d6dc-69f2-460f-941f-750eec6d38cd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.149060 Aug 30 02:01:38.729342 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 416/798] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:38 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:38.896541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-976703060", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2051291069", "security_groups": [{"name": "tempest-secgroup-smoke-83394517"}], "block_device_mapping_v2": [{"uuid": "59f1b453-8893-422f-b724-2f277dd92906", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6493208c-2d03-4273-9fca-307a3c4e68fa"}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:39.012691 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] validate_networks() for [('6493208c-2d03-4273-9fca-307a3c4e68fa', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:01:39.174597 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7d9ec2ed-a496-41cd-9205-1a4f768498bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:39.175359 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7d9ec2ed-a496-41cd-9205-1a4f768498bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:39.181354 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9ec2ed-a496-41cd-9205-1a4f768498bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:39.181911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9ec2ed-a496-41cd-9205-1a4f768498bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:39.182341 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9ec2ed-a496-41cd-9205-1a4f768498bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:39.183042 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9ec2ed-a496-41cd-9205-1a4f768498bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:39.183451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9ec2ed-a496-41cd-9205-1a4f768498bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:39.183864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7d9ec2ed-a496-41cd-9205-1a4f768498bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:39.314672 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7d9ec2ed-a496-41cd-9205-1a4f768498bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:39.322356 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7d9ec2ed-a496-41cd-9205-1a4f768498bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1318 microversion: 2.1 time: 0.151564 Aug 30 02:01:39.323002 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 417/799] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:39 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:39.373646 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:01:39.374067 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:01:39.374538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:01:39.374945 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:01:39.375353 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:01:39.377419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=72 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:39.388934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:39.389440 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:39.390515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:39.391264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:39.391786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:39.392210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:39.409532 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Getting quotas for project 74610e8b7b4d4fafa0e49ba73b94aa48. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:01:39.413449 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Getting quotas for user bd08361520db465bb9069326d03d0307 and project 74610e8b7b4d4fafa0e49ba73b94aa48. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:01:39.469297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:01:39.471429 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59f1b453-8893-422f-b724-2f277dd92906',volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:01:39.598971 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5e210306-6267-439c-bec0-b2e491372ec7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.706235 Aug 30 02:01:39.599608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 383/800] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 02:01:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:01:39.610261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-29d271fe-5d73-4209-869d-64bc10801f70 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:39.610868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-29d271fe-5d73-4209-869d-64bc10801f70 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:39.664485 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-29d271fe-5d73-4209-869d-64bc10801f70 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:39.672305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-29d271fe-5d73-4209-869d-64bc10801f70 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1094 microversion: 2.1 time: 0.065834 Aug 30 02:01:39.672874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 418/801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:39 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:39.753144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:39.753751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:39.761386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:39.761864 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:39.762292 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:39.762974 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:39.763419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:39.763835 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:39.914879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:39.925100 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:39.926818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:39.928031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-36c5e8ee-0a40-4d3d-ad5d-f24061fac189 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.179630 Aug 30 02:01:39.928621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 384/802] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:39 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:40.292060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-77832b21-d82f-4d2e-80ea-0635cbd0218c req-6923c158-3cb3-4fd7-98bb-15739610362c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51036535-5cf5-4283-b501-b0809e3f57a6", "name": "network-vif-plugged", "status": "completed", "tag": "b76470f7-925f-4c0c-b128-d7b4fbc6e636"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:40.305796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-77832b21-d82f-4d2e-80ea-0635cbd0218c req-6923c158-3cb3-4fd7-98bb-15739610362c service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:40.306392 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-77832b21-d82f-4d2e-80ea-0635cbd0218c req-6923c158-3cb3-4fd7-98bb-15739610362c service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:40.307621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-77832b21-d82f-4d2e-80ea-0635cbd0218c req-6923c158-3cb3-4fd7-98bb-15739610362c service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:40.320469 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-77832b21-d82f-4d2e-80ea-0635cbd0218c req-6923c158-3cb3-4fd7-98bb-15739610362c service nova] Creating event network-vif-plugged:b76470f7-925f-4c0c-b128-d7b4fbc6e636 for instance 51036535-5cf5-4283-b501-b0809e3f57a6 on hv-cinder-81966 Aug 30 02:01:40.327076 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-77832b21-d82f-4d2e-80ea-0635cbd0218c req-6923c158-3cb3-4fd7-98bb-15739610362c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039474 Aug 30 02:01:40.328315 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 419/803] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:01:40.342007 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0cbf751c-ae6d-434d-afda-3052fa4ab881 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:40.343498 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0cbf751c-ae6d-434d-afda-3052fa4ab881 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:40.349634 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0cbf751c-ae6d-434d-afda-3052fa4ab881 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:40.350186 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0cbf751c-ae6d-434d-afda-3052fa4ab881 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:40.350736 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0cbf751c-ae6d-434d-afda-3052fa4ab881 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:40.352043 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0cbf751c-ae6d-434d-afda-3052fa4ab881 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:40.352825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0cbf751c-ae6d-434d-afda-3052fa4ab881 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:40.353432 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0cbf751c-ae6d-434d-afda-3052fa4ab881 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:40.499210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0cbf751c-ae6d-434d-afda-3052fa4ab881 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:40.506961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0cbf751c-ae6d-434d-afda-3052fa4ab881 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1507 microversion: 2.1 time: 0.168895 Aug 30 02:01:40.507542 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 385/804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:40 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:40.527123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0710aaa8-04b3-427a-9bc8-d9d7fe27f0bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d0bdbf7-1ec2-498f-bf47-4bdec4292dfd", "device": "/dev/sdb"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:40.529663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0710aaa8-04b3-427a-9bc8-d9d7fe27f0bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:40.535598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710aaa8-04b3-427a-9bc8-d9d7fe27f0bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:40.536132 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710aaa8-04b3-427a-9bc8-d9d7fe27f0bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:40.536604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710aaa8-04b3-427a-9bc8-d9d7fe27f0bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:40.537277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710aaa8-04b3-427a-9bc8-d9d7fe27f0bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:40.537721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710aaa8-04b3-427a-9bc8-d9d7fe27f0bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:40.538134 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710aaa8-04b3-427a-9bc8-d9d7fe27f0bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:40.542264 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:40.693307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5a03407f-2f22-493f-8c14-7ea3cc5d7d57 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:40.693941 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5a03407f-2f22-493f-8c14-7ea3cc5d7d57 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:40.700010 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a03407f-2f22-493f-8c14-7ea3cc5d7d57 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:40.700661 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a03407f-2f22-493f-8c14-7ea3cc5d7d57 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:40.701100 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a03407f-2f22-493f-8c14-7ea3cc5d7d57 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:40.701794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a03407f-2f22-493f-8c14-7ea3cc5d7d57 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:40.702249 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a03407f-2f22-493f-8c14-7ea3cc5d7d57 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:40.702674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a03407f-2f22-493f-8c14-7ea3cc5d7d57 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:40.706613 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:40.763261 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5a03407f-2f22-493f-8c14-7ea3cc5d7d57 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:40.770768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5a03407f-2f22-493f-8c14-7ea3cc5d7d57 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1192 microversion: 2.1 time: 0.081516 Aug 30 02:01:40.771323 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 386/805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:40 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:40.958261 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:40.959466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:40.965966 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:40.966452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:40.966883 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:40.967573 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:40.968025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:40.968480 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:41.112507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:41.122122 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:41.123841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:41.125244 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c28059f8-ae97-4c01-89b1-92bbb6cf9308 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.171978 Aug 30 02:01:41.126066 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 387/806] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:40 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:41.259846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0710aaa8-04b3-427a-9bc8-d9d7fe27f0bf tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "POST /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.736785 Aug 30 02:01:41.264045 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 420/807] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 02:01:40 2022] POST /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:01:41.791359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6cb9d4b6-28dd-4444-9c66-a5524228896f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:41.792002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6cb9d4b6-28dd-4444-9c66-a5524228896f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:41.798404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cb9d4b6-28dd-4444-9c66-a5524228896f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:41.798888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cb9d4b6-28dd-4444-9c66-a5524228896f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:41.799317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cb9d4b6-28dd-4444-9c66-a5524228896f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:41.800002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cb9d4b6-28dd-4444-9c66-a5524228896f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:41.800477 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cb9d4b6-28dd-4444-9c66-a5524228896f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:41.800900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cb9d4b6-28dd-4444-9c66-a5524228896f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:41.863698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6cb9d4b6-28dd-4444-9c66-a5524228896f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:41.871779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6cb9d4b6-28dd-4444-9c66-a5524228896f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1192 microversion: 2.1 time: 0.084834 Aug 30 02:01:41.872350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 388/808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:41 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:42.152495 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:42.153305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:42.159319 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:42.159792 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:42.160273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:42.160955 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:42.161406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:42.161823 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:42.502001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:42.510911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:42.512396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:42.513562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d7e1aa85-9a57-4845-af08-92dac15df867 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.366371 Aug 30 02:01:42.514108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 421/809] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:42 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:42.892308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-511670e7-d25c-478c-9a7a-eb8732072d23 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:42.892911 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-511670e7-d25c-478c-9a7a-eb8732072d23 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:42.899979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-511670e7-d25c-478c-9a7a-eb8732072d23 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:42.900525 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-511670e7-d25c-478c-9a7a-eb8732072d23 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:42.900960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-511670e7-d25c-478c-9a7a-eb8732072d23 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:42.901654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-511670e7-d25c-478c-9a7a-eb8732072d23 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:42.902105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-511670e7-d25c-478c-9a7a-eb8732072d23 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:42.902528 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-511670e7-d25c-478c-9a7a-eb8732072d23 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:42.965295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-511670e7-d25c-478c-9a7a-eb8732072d23 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:42.972845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-511670e7-d25c-478c-9a7a-eb8732072d23 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1192 microversion: 2.1 time: 0.084352 Aug 30 02:01:42.973408 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 389/810] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:42 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:43.538476 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:43.539556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:43.545943 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:43.546412 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:43.546835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:43.547509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:43.547954 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:43.548404 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:43.775671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:43.784191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:43.785640 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:43.786779 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-fc5cfee3-484b-45d1-9f27-02e0625aa4d6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.252259 Aug 30 02:01:43.787326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 422/811] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:43 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:43.993670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a9f539ca-0922-4648-bc81-7ffda973b2eb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:43.994257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a9f539ca-0922-4648-bc81-7ffda973b2eb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:44.000751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f539ca-0922-4648-bc81-7ffda973b2eb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:44.001238 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f539ca-0922-4648-bc81-7ffda973b2eb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:44.001692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f539ca-0922-4648-bc81-7ffda973b2eb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:44.002371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f539ca-0922-4648-bc81-7ffda973b2eb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:44.002827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f539ca-0922-4648-bc81-7ffda973b2eb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:44.003252 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a9f539ca-0922-4648-bc81-7ffda973b2eb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:44.066108 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a9f539ca-0922-4648-bc81-7ffda973b2eb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:44.073821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a9f539ca-0922-4648-bc81-7ffda973b2eb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1210 microversion: 2.1 time: 0.084631 Aug 30 02:01:44.074834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 390/812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:43 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:44.812665 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:44.813260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:44.820371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:44.820964 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:44.821449 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:44.822165 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:44.822615 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:44.823033 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:45.018166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:45.029817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:45.031231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:45.032412 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5d76c29c-12f6-4394-bbb8-d27b6e5760b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1806 microversion: 2.20 time: 0.223659 Aug 30 02:01:45.033162 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 423/813] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:44 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1806 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:01:45.095115 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d39f4136-b36a-457a-804e-ecfec1c1e460 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:45.095657 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d39f4136-b36a-457a-804e-ecfec1c1e460 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:45.102660 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d39f4136-b36a-457a-804e-ecfec1c1e460 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:45.103138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d39f4136-b36a-457a-804e-ecfec1c1e460 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:45.103836 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d39f4136-b36a-457a-804e-ecfec1c1e460 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:45.104554 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d39f4136-b36a-457a-804e-ecfec1c1e460 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:45.105002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d39f4136-b36a-457a-804e-ecfec1c1e460 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:45.105418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d39f4136-b36a-457a-804e-ecfec1c1e460 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:45.238813 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d39f4136-b36a-457a-804e-ecfec1c1e460 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:45.247255 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d39f4136-b36a-457a-804e-ecfec1c1e460 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.156123 Aug 30 02:01:45.247907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 391/814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:45 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:45.494106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-e204c737-b7b4-4819-b746-1f2758d858f6 req-dd113691-58d1-404a-9261-325f1ad02223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e06f030-1187-44b2-bf6d-dfff52fbbc06", "tag": "0275d53a-fdb2-4036-b793-03c933bc3ad0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:45.504362 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-e204c737-b7b4-4819-b746-1f2758d858f6 req-dd113691-58d1-404a-9261-325f1ad02223 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:45.504839 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-e204c737-b7b4-4819-b746-1f2758d858f6 req-dd113691-58d1-404a-9261-325f1ad02223 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:45.505270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-e204c737-b7b4-4819-b746-1f2758d858f6 req-dd113691-58d1-404a-9261-325f1ad02223 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:45.516910 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-e204c737-b7b4-4819-b746-1f2758d858f6 req-dd113691-58d1-404a-9261-325f1ad02223 service nova] Creating event network-changed:0275d53a-fdb2-4036-b793-03c933bc3ad0 for instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 on hv-cinder-81966 Aug 30 02:01:45.522326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-e204c737-b7b4-4819-b746-1f2758d858f6 req-dd113691-58d1-404a-9261-325f1ad02223 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032430 Aug 30 02:01:45.523086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 424/815] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:01:46.057104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:46.057709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:46.064032 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:46.064550 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:46.064984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:46.065676 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:46.066129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:46.066543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:46.196200 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:46.205002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:46.206521 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:46.207669 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-46eeea79-730c-4330-9d59-60e4d57aec0a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1793 microversion: 2.20 time: 0.154513 Aug 30 02:01:46.208223 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 392/816] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:01:46 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1793 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:46.269583 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-13b34e91-e07b-40ef-bd70-dfc863571b17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:46.270557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-13b34e91-e07b-40ef-bd70-dfc863571b17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:46.277265 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-13b34e91-e07b-40ef-bd70-dfc863571b17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:46.277748 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-13b34e91-e07b-40ef-bd70-dfc863571b17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:46.278184 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-13b34e91-e07b-40ef-bd70-dfc863571b17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:46.278870 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-13b34e91-e07b-40ef-bd70-dfc863571b17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:46.279320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-13b34e91-e07b-40ef-bd70-dfc863571b17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:46.279743 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-13b34e91-e07b-40ef-bd70-dfc863571b17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:46.486192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-13b34e91-e07b-40ef-bd70-dfc863571b17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:46.493876 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-13b34e91-e07b-40ef-bd70-dfc863571b17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.228945 Aug 30 02:01:46.494543 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 425/817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:46 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:47.515067 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a2ecbc79-693a-47d5-80f2-7d404094f8de tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:47.515670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a2ecbc79-693a-47d5-80f2-7d404094f8de tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:47.522150 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2ecbc79-693a-47d5-80f2-7d404094f8de tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:47.522629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2ecbc79-693a-47d5-80f2-7d404094f8de tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:47.523055 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2ecbc79-693a-47d5-80f2-7d404094f8de tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:47.523739 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2ecbc79-693a-47d5-80f2-7d404094f8de tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:47.524184 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2ecbc79-693a-47d5-80f2-7d404094f8de tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:47.524624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2ecbc79-693a-47d5-80f2-7d404094f8de tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:47.653158 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a2ecbc79-693a-47d5-80f2-7d404094f8de tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:47.660808 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a2ecbc79-693a-47d5-80f2-7d404094f8de tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.149506 Aug 30 02:01:47.661368 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 393/818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:47 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:48.681989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-74251c52-1182-4927-a3d2-a2df2c848a62 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:48.682515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-74251c52-1182-4927-a3d2-a2df2c848a62 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:48.688983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74251c52-1182-4927-a3d2-a2df2c848a62 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:48.689458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74251c52-1182-4927-a3d2-a2df2c848a62 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:48.689890 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74251c52-1182-4927-a3d2-a2df2c848a62 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:48.690577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74251c52-1182-4927-a3d2-a2df2c848a62 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:48.691172 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74251c52-1182-4927-a3d2-a2df2c848a62 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:48.691435 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74251c52-1182-4927-a3d2-a2df2c848a62 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:48.823848 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-74251c52-1182-4927-a3d2-a2df2c848a62 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:48.831541 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-74251c52-1182-4927-a3d2-a2df2c848a62 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.154136 Aug 30 02:01:48.832106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 426/819] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:48 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:01:49.851855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cb0b088d-9e0f-4c7a-9965-29b5a0d60853 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:49.852515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cb0b088d-9e0f-4c7a-9965-29b5a0d60853 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:49.854844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:49.855660 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:49.861261 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb0b088d-9e0f-4c7a-9965-29b5a0d60853 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:49.861742 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb0b088d-9e0f-4c7a-9965-29b5a0d60853 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:49.862177 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb0b088d-9e0f-4c7a-9965-29b5a0d60853 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:49.862859 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb0b088d-9e0f-4c7a-9965-29b5a0d60853 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:49.863310 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb0b088d-9e0f-4c7a-9965-29b5a0d60853 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:49.863722 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cb0b088d-9e0f-4c7a-9965-29b5a0d60853 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:49.995099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cb0b088d-9e0f-4c7a-9965-29b5a0d60853 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:50.002933 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cb0b088d-9e0f-4c7a-9965-29b5a0d60853 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.154849 Aug 30 02:01:50.003489 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 394/820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:49 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:51.023435 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-96048de9-3930-4e23-9db5-95e914923796 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:51.024073 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-96048de9-3930-4e23-9db5-95e914923796 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:51.026080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:51.031750 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96048de9-3930-4e23-9db5-95e914923796 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:51.032221 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96048de9-3930-4e23-9db5-95e914923796 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:51.032668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96048de9-3930-4e23-9db5-95e914923796 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:51.033344 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96048de9-3930-4e23-9db5-95e914923796 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:51.033793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96048de9-3930-4e23-9db5-95e914923796 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:51.034212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-96048de9-3930-4e23-9db5-95e914923796 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:51.163352 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-96048de9-3930-4e23-9db5-95e914923796 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:51.171512 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-96048de9-3930-4e23-9db5-95e914923796 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.151897 Aug 30 02:01:51.172060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 427/821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:51 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:52.191065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-36add427-034f-4534-9dc7-c9cd227c52c7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:52.191581 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-36add427-034f-4534-9dc7-c9cd227c52c7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:52.198084 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36add427-034f-4534-9dc7-c9cd227c52c7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:52.198525 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36add427-034f-4534-9dc7-c9cd227c52c7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:52.198956 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36add427-034f-4534-9dc7-c9cd227c52c7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:52.199659 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36add427-034f-4534-9dc7-c9cd227c52c7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:52.200110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36add427-034f-4534-9dc7-c9cd227c52c7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:52.200570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-36add427-034f-4534-9dc7-c9cd227c52c7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:52.327220 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-36add427-034f-4534-9dc7-c9cd227c52c7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:52.334872 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-36add427-034f-4534-9dc7-c9cd227c52c7 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.147801 Aug 30 02:01:52.336021 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 395/822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:52 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:53.356226 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7dbf768a-49e0-4578-8ebd-cb7a820cbb7e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:53.356851 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7dbf768a-49e0-4578-8ebd-cb7a820cbb7e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:53.363298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dbf768a-49e0-4578-8ebd-cb7a820cbb7e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:53.363776 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dbf768a-49e0-4578-8ebd-cb7a820cbb7e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:53.364232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dbf768a-49e0-4578-8ebd-cb7a820cbb7e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:53.364933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dbf768a-49e0-4578-8ebd-cb7a820cbb7e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:53.365400 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dbf768a-49e0-4578-8ebd-cb7a820cbb7e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:53.365843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7dbf768a-49e0-4578-8ebd-cb7a820cbb7e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:53.501413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7dbf768a-49e0-4578-8ebd-cb7a820cbb7e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:53.509153 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7dbf768a-49e0-4578-8ebd-cb7a820cbb7e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.156803 Aug 30 02:01:53.509712 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 428/823] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:53 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:54.529463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9f1dcb19-7d4e-4781-8721-21be9d868283 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:54.530071 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9f1dcb19-7d4e-4781-8721-21be9d868283 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:54.536507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f1dcb19-7d4e-4781-8721-21be9d868283 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:54.536984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f1dcb19-7d4e-4781-8721-21be9d868283 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:54.537413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f1dcb19-7d4e-4781-8721-21be9d868283 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:54.538090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f1dcb19-7d4e-4781-8721-21be9d868283 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:54.539070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f1dcb19-7d4e-4781-8721-21be9d868283 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:54.539488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f1dcb19-7d4e-4781-8721-21be9d868283 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:54.667795 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9f1dcb19-7d4e-4781-8721-21be9d868283 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:54.675312 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9f1dcb19-7d4e-4781-8721-21be9d868283 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.149690 Aug 30 02:01:54.675867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 396/824] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:54 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:55.697186 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3c72121e-fc72-4191-a2d8-1915a919a65d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:55.697762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3c72121e-fc72-4191-a2d8-1915a919a65d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:55.700157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=54 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:55.706339 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3c72121e-fc72-4191-a2d8-1915a919a65d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:55.706824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3c72121e-fc72-4191-a2d8-1915a919a65d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:55.707264 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3c72121e-fc72-4191-a2d8-1915a919a65d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:55.707963 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3c72121e-fc72-4191-a2d8-1915a919a65d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:55.708456 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3c72121e-fc72-4191-a2d8-1915a919a65d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:55.708885 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3c72121e-fc72-4191-a2d8-1915a919a65d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:55.838494 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3c72121e-fc72-4191-a2d8-1915a919a65d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:55.846944 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3c72121e-fc72-4191-a2d8-1915a919a65d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.154480 Aug 30 02:01:55.847515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 429/825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:55 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:56.867920 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8dde30f6-6fa2-4b43-a729-8561d960f37d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:56.868563 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8dde30f6-6fa2-4b43-a729-8561d960f37d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:56.874976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8dde30f6-6fa2-4b43-a729-8561d960f37d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:56.875461 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8dde30f6-6fa2-4b43-a729-8561d960f37d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:56.875893 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8dde30f6-6fa2-4b43-a729-8561d960f37d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:56.876607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8dde30f6-6fa2-4b43-a729-8561d960f37d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:56.877065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8dde30f6-6fa2-4b43-a729-8561d960f37d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:56.877490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8dde30f6-6fa2-4b43-a729-8561d960f37d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:57.008800 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8dde30f6-6fa2-4b43-a729-8561d960f37d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:57.016462 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8dde30f6-6fa2-4b43-a729-8561d960f37d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.153004 Aug 30 02:01:57.017013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 397/826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:56 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:58.036837 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ee971f87-8d17-46cd-b6ce-e5f7b8bfa9cc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:58.037463 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ee971f87-8d17-46cd-b6ce-e5f7b8bfa9cc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:58.043953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee971f87-8d17-46cd-b6ce-e5f7b8bfa9cc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:58.044466 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee971f87-8d17-46cd-b6ce-e5f7b8bfa9cc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:58.044896 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee971f87-8d17-46cd-b6ce-e5f7b8bfa9cc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:58.045631 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee971f87-8d17-46cd-b6ce-e5f7b8bfa9cc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:58.046163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee971f87-8d17-46cd-b6ce-e5f7b8bfa9cc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:58.046659 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee971f87-8d17-46cd-b6ce-e5f7b8bfa9cc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:58.187360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ee971f87-8d17-46cd-b6ce-e5f7b8bfa9cc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:58.195693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ee971f87-8d17-46cd-b6ce-e5f7b8bfa9cc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1276 microversion: 2.1 time: 0.162197 Aug 30 02:01:58.196584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 430/827] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:58 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:01:59.216881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0a629dde-8224-49c4-ab59-3861c3058aec tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:59.217403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0a629dde-8224-49c4-ab59-3861c3058aec tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:01:59.223764 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a629dde-8224-49c4-ab59-3861c3058aec tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:59.224268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a629dde-8224-49c4-ab59-3861c3058aec tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:59.224692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a629dde-8224-49c4-ab59-3861c3058aec tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:59.225391 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a629dde-8224-49c4-ab59-3861c3058aec tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:59.226346 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a629dde-8224-49c4-ab59-3861c3058aec tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:59.226761 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0a629dde-8224-49c4-ab59-3861c3058aec tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:59.354187 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0a629dde-8224-49c4-ab59-3861c3058aec tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:01:59.361999 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0a629dde-8224-49c4-ab59-3861c3058aec tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.149116 Aug 30 02:01:59.362562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 398/828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:01:59 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:00.384261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-78ad288a-80b2-4f03-b975-82ad152590da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:00.384887 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-78ad288a-80b2-4f03-b975-82ad152590da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:00.391224 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78ad288a-80b2-4f03-b975-82ad152590da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:00.391704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78ad288a-80b2-4f03-b975-82ad152590da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:00.392138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78ad288a-80b2-4f03-b975-82ad152590da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:00.392845 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78ad288a-80b2-4f03-b975-82ad152590da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:00.393298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78ad288a-80b2-4f03-b975-82ad152590da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:00.393748 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78ad288a-80b2-4f03-b975-82ad152590da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:00.523748 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-78ad288a-80b2-4f03-b975-82ad152590da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:00.531341 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-78ad288a-80b2-4f03-b975-82ad152590da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.151947 Aug 30 02:02:00.531905 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 431/829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:00 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:01.552164 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f0305164-9fbf-47f6-beb0-b1918499cf6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:01.552746 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f0305164-9fbf-47f6-beb0-b1918499cf6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:01.559171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0305164-9fbf-47f6-beb0-b1918499cf6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:01.559652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0305164-9fbf-47f6-beb0-b1918499cf6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:01.560095 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0305164-9fbf-47f6-beb0-b1918499cf6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:01.560816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0305164-9fbf-47f6-beb0-b1918499cf6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:01.561299 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0305164-9fbf-47f6-beb0-b1918499cf6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:01.561723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0305164-9fbf-47f6-beb0-b1918499cf6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:01.692167 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f0305164-9fbf-47f6-beb0-b1918499cf6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:01.700385 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f0305164-9fbf-47f6-beb0-b1918499cf6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.152054 Aug 30 02:02:01.700942 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 399/830] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:01 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:02.721283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2e6813fc-4cbf-43f4-8d2f-7e81b466b53b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:02.721802 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2e6813fc-4cbf-43f4-8d2f-7e81b466b53b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:02.728269 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2e6813fc-4cbf-43f4-8d2f-7e81b466b53b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:02.728770 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2e6813fc-4cbf-43f4-8d2f-7e81b466b53b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:02.729200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2e6813fc-4cbf-43f4-8d2f-7e81b466b53b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:02.729878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2e6813fc-4cbf-43f4-8d2f-7e81b466b53b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:02.730328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2e6813fc-4cbf-43f4-8d2f-7e81b466b53b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:02.730753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2e6813fc-4cbf-43f4-8d2f-7e81b466b53b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:02.857344 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2e6813fc-4cbf-43f4-8d2f-7e81b466b53b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:02.864968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2e6813fc-4cbf-43f4-8d2f-7e81b466b53b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.147566 Aug 30 02:02:02.865526 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 432/831] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:02 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:03.886363 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c42a2526-5740-4fca-9f73-6f0da914544d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:03.886894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c42a2526-5740-4fca-9f73-6f0da914544d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:03.893285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c42a2526-5740-4fca-9f73-6f0da914544d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:03.893761 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c42a2526-5740-4fca-9f73-6f0da914544d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:03.894188 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c42a2526-5740-4fca-9f73-6f0da914544d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:03.894861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c42a2526-5740-4fca-9f73-6f0da914544d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:03.895306 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c42a2526-5740-4fca-9f73-6f0da914544d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:03.895723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c42a2526-5740-4fca-9f73-6f0da914544d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:04.021752 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c42a2526-5740-4fca-9f73-6f0da914544d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:04.029735 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c42a2526-5740-4fca-9f73-6f0da914544d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.147253 Aug 30 02:02:04.030287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 400/832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:03 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:05.050208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e51e08b1-0ded-4a14-a209-ea55cd8dd38b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:05.050809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e51e08b1-0ded-4a14-a209-ea55cd8dd38b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:05.057682 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e51e08b1-0ded-4a14-a209-ea55cd8dd38b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:05.058157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e51e08b1-0ded-4a14-a209-ea55cd8dd38b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:05.058582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e51e08b1-0ded-4a14-a209-ea55cd8dd38b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:05.059255 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e51e08b1-0ded-4a14-a209-ea55cd8dd38b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:05.059706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e51e08b1-0ded-4a14-a209-ea55cd8dd38b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:05.060125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e51e08b1-0ded-4a14-a209-ea55cd8dd38b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:05.197581 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e51e08b1-0ded-4a14-a209-ea55cd8dd38b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:05.205307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e51e08b1-0ded-4a14-a209-ea55cd8dd38b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.159011 Aug 30 02:02:05.205865 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 433/833] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:05 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:06.225569 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4ae90191-67ca-43c5-83b0-ee505d48cf28 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:06.226781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4ae90191-67ca-43c5-83b0-ee505d48cf28 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:06.233126 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ae90191-67ca-43c5-83b0-ee505d48cf28 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:06.233601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ae90191-67ca-43c5-83b0-ee505d48cf28 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:06.234025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ae90191-67ca-43c5-83b0-ee505d48cf28 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:06.234703 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ae90191-67ca-43c5-83b0-ee505d48cf28 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:06.235144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ae90191-67ca-43c5-83b0-ee505d48cf28 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:06.235568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ae90191-67ca-43c5-83b0-ee505d48cf28 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:06.364834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4ae90191-67ca-43c5-83b0-ee505d48cf28 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:06.372333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4ae90191-67ca-43c5-83b0-ee505d48cf28 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.150597 Aug 30 02:02:06.372880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 401/834] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:06 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:07.393063 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0027a5f6-3079-4042-998a-0177fe075282 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:07.393606 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0027a5f6-3079-4042-998a-0177fe075282 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:07.399987 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0027a5f6-3079-4042-998a-0177fe075282 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:07.400498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0027a5f6-3079-4042-998a-0177fe075282 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:07.400935 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0027a5f6-3079-4042-998a-0177fe075282 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:07.401611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0027a5f6-3079-4042-998a-0177fe075282 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:07.402061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0027a5f6-3079-4042-998a-0177fe075282 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:07.402483 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0027a5f6-3079-4042-998a-0177fe075282 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:07.530469 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0027a5f6-3079-4042-998a-0177fe075282 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:07.538135 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0027a5f6-3079-4042-998a-0177fe075282 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.148967 Aug 30 02:02:07.538681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 434/835] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:07 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:07.910810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9027c77f-560f-42d5-8a9c-2e19da6b8281 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:07.911356 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9027c77f-560f-42d5-8a9c-2e19da6b8281 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:07.917605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9027c77f-560f-42d5-8a9c-2e19da6b8281 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:07.918086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9027c77f-560f-42d5-8a9c-2e19da6b8281 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:07.918517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9027c77f-560f-42d5-8a9c-2e19da6b8281 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:07.919203 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9027c77f-560f-42d5-8a9c-2e19da6b8281 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:07.919652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9027c77f-560f-42d5-8a9c-2e19da6b8281 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:07.920079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9027c77f-560f-42d5-8a9c-2e19da6b8281 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:08.045934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:08.050789 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-9027c77f-560f-42d5-8a9c-2e19da6b8281 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lazy-loading 'services' on Instance uuid 65eab266-f475-47c5-98a1-070a67ff8e68 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:02:08.162943 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9027c77f-560f-42d5-8a9c-2e19da6b8281 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "DELETE /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68/os-volume_attachments/6d0bdbf7-1ec2-498f-bf47-4bdec4292dfd" status: 202 len: 0 microversion: 2.1 time: 0.257269 Aug 30 02:02:08.163932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 402/836] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:02:07 2022] DELETE /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68/os-volume_attachments/6d0bdbf7-1ec2-498f-bf47-4bdec4292dfd => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:02:08.559101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8f305ea5-b965-4659-a35a-c623d6551c17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:08.559695 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8f305ea5-b965-4659-a35a-c623d6551c17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:08.566059 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f305ea5-b965-4659-a35a-c623d6551c17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:08.566533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f305ea5-b965-4659-a35a-c623d6551c17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:08.566987 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f305ea5-b965-4659-a35a-c623d6551c17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:08.567687 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f305ea5-b965-4659-a35a-c623d6551c17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:08.568133 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f305ea5-b965-4659-a35a-c623d6551c17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:08.568588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f305ea5-b965-4659-a35a-c623d6551c17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:08.699056 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8f305ea5-b965-4659-a35a-c623d6551c17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:08.706665 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8f305ea5-b965-4659-a35a-c623d6551c17 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.151480 Aug 30 02:02:08.707220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 435/837] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:08 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:09.727024 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-280441e9-66fa-4c71-9a93-4933778cd0d9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:09.727658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-280441e9-66fa-4c71-9a93-4933778cd0d9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:09.730048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:09.736116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-280441e9-66fa-4c71-9a93-4933778cd0d9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:09.736625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-280441e9-66fa-4c71-9a93-4933778cd0d9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:09.737056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-280441e9-66fa-4c71-9a93-4933778cd0d9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:09.737747 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-280441e9-66fa-4c71-9a93-4933778cd0d9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:09.738180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-280441e9-66fa-4c71-9a93-4933778cd0d9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:09.738598 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-280441e9-66fa-4c71-9a93-4933778cd0d9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:09.865266 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-280441e9-66fa-4c71-9a93-4933778cd0d9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:09.872788 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-280441e9-66fa-4c71-9a93-4933778cd0d9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.150105 Aug 30 02:02:09.873338 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 403/838] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:09 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:10.343656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f729b3b2-0875-4196-95d4-af7ad5db7bea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:10.344152 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f729b3b2-0875-4196-95d4-af7ad5db7bea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:10.350460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f729b3b2-0875-4196-95d4-af7ad5db7bea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:10.351428 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f729b3b2-0875-4196-95d4-af7ad5db7bea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:10.351859 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f729b3b2-0875-4196-95d4-af7ad5db7bea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:10.352565 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f729b3b2-0875-4196-95d4-af7ad5db7bea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:10.353016 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f729b3b2-0875-4196-95d4-af7ad5db7bea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:10.353432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f729b3b2-0875-4196-95d4-af7ad5db7bea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:10.357281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:10.379714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f729b3b2-0875-4196-95d4-af7ad5db7bea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Going to try to terminate instance {{(pid=120391) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:02:10.459022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f729b3b2-0875-4196-95d4-af7ad5db7bea tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "DELETE /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 204 len: 0 microversion: 2.1 time: 0.118859 Aug 30 02:02:10.459594 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 436/839] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:02:10 2022] DELETE /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:02:10.467561 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-305bf600-483c-4975-983f-640aec73ff1a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:10.468177 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-305bf600-483c-4975-983f-640aec73ff1a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:10.474050 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-305bf600-483c-4975-983f-640aec73ff1a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:10.474525 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-305bf600-483c-4975-983f-640aec73ff1a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:10.474953 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-305bf600-483c-4975-983f-640aec73ff1a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:10.476127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-305bf600-483c-4975-983f-640aec73ff1a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:10.476598 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-305bf600-483c-4975-983f-640aec73ff1a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:10.477036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-305bf600-483c-4975-983f-640aec73ff1a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:10.609313 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-305bf600-483c-4975-983f-640aec73ff1a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:10.617640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-305bf600-483c-4975-983f-640aec73ff1a tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1513 microversion: 2.1 time: 0.153836 Aug 30 02:02:10.618233 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 404/840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:10 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:10.894933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-78e90d38-618f-43b3-be60-d3a144512f61 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:10.895636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-78e90d38-618f-43b3-be60-d3a144512f61 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:10.902080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78e90d38-618f-43b3-be60-d3a144512f61 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:10.902562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78e90d38-618f-43b3-be60-d3a144512f61 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:10.902994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78e90d38-618f-43b3-be60-d3a144512f61 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:10.903676 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78e90d38-618f-43b3-be60-d3a144512f61 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:10.904130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78e90d38-618f-43b3-be60-d3a144512f61 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:10.904580 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78e90d38-618f-43b3-be60-d3a144512f61 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:11.031835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-78e90d38-618f-43b3-be60-d3a144512f61 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:11.039956 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-78e90d38-618f-43b3-be60-d3a144512f61 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.149225 Aug 30 02:02:11.040554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 437/841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:10 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:11.638650 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-85e47595-3493-4c5e-b9de-b4b3949db604 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:11.639170 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-85e47595-3493-4c5e-b9de-b4b3949db604 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:11.645965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85e47595-3493-4c5e-b9de-b4b3949db604 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:11.646453 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85e47595-3493-4c5e-b9de-b4b3949db604 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:11.646888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85e47595-3493-4c5e-b9de-b4b3949db604 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:11.647608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85e47595-3493-4c5e-b9de-b4b3949db604 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:11.648088 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85e47595-3493-4c5e-b9de-b4b3949db604 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:11.648536 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-85e47595-3493-4c5e-b9de-b4b3949db604 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:11.777625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-85e47595-3493-4c5e-b9de-b4b3949db604 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:11.785140 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-85e47595-3493-4c5e-b9de-b4b3949db604 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1513 microversion: 2.1 time: 0.150361 Aug 30 02:02:11.785698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 405/842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:11 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:12.060226 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6a24aeec-b966-4cdb-a243-f0a24fb81002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:12.060865 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6a24aeec-b966-4cdb-a243-f0a24fb81002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:12.067343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a24aeec-b966-4cdb-a243-f0a24fb81002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:12.067848 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a24aeec-b966-4cdb-a243-f0a24fb81002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:12.068365 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a24aeec-b966-4cdb-a243-f0a24fb81002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:12.069257 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a24aeec-b966-4cdb-a243-f0a24fb81002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:12.069721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a24aeec-b966-4cdb-a243-f0a24fb81002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:12.070151 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a24aeec-b966-4cdb-a243-f0a24fb81002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:12.200738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6a24aeec-b966-4cdb-a243-f0a24fb81002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:12.208374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6a24aeec-b966-4cdb-a243-f0a24fb81002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.151944 Aug 30 02:02:12.208937 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 438/843] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:12 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:12.806775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-38cb4eb1-9d14-42ec-845f-f9ca088134f7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:12.807381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-38cb4eb1-9d14-42ec-845f-f9ca088134f7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:12.813603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cb4eb1-9d14-42ec-845f-f9ca088134f7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:12.814074 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cb4eb1-9d14-42ec-845f-f9ca088134f7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:12.814500 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cb4eb1-9d14-42ec-845f-f9ca088134f7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:12.815172 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cb4eb1-9d14-42ec-845f-f9ca088134f7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:12.815618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cb4eb1-9d14-42ec-845f-f9ca088134f7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:12.816033 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38cb4eb1-9d14-42ec-845f-f9ca088134f7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:12.947263 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-38cb4eb1-9d14-42ec-845f-f9ca088134f7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:12.954791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-38cb4eb1-9d14-42ec-845f-f9ca088134f7 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1513 microversion: 2.1 time: 0.151836 Aug 30 02:02:12.955339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 406/844] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:12 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:13.229075 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6205d681-8a0c-48b8-b750-1f1a89e8addb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:13.229660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6205d681-8a0c-48b8-b750-1f1a89e8addb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:13.236150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6205d681-8a0c-48b8-b750-1f1a89e8addb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:13.236669 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6205d681-8a0c-48b8-b750-1f1a89e8addb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:13.237101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6205d681-8a0c-48b8-b750-1f1a89e8addb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:13.237793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6205d681-8a0c-48b8-b750-1f1a89e8addb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:13.238243 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6205d681-8a0c-48b8-b750-1f1a89e8addb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:13.238664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6205d681-8a0c-48b8-b750-1f1a89e8addb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:13.372200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6205d681-8a0c-48b8-b750-1f1a89e8addb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:13.379907 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6205d681-8a0c-48b8-b750-1f1a89e8addb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.154721 Aug 30 02:02:13.380499 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 439/845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:13 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:13.974877 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e03dadcf-115e-4bac-93fd-af6b93f9d97c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:13.975463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e03dadcf-115e-4bac-93fd-af6b93f9d97c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:13.982621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e03dadcf-115e-4bac-93fd-af6b93f9d97c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:13.983089 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e03dadcf-115e-4bac-93fd-af6b93f9d97c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:13.983513 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e03dadcf-115e-4bac-93fd-af6b93f9d97c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:13.984186 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e03dadcf-115e-4bac-93fd-af6b93f9d97c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:13.984652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e03dadcf-115e-4bac-93fd-af6b93f9d97c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:13.985070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e03dadcf-115e-4bac-93fd-af6b93f9d97c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:14.112116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e03dadcf-115e-4bac-93fd-af6b93f9d97c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:14.119652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e03dadcf-115e-4bac-93fd-af6b93f9d97c tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1513 microversion: 2.1 time: 0.148628 Aug 30 02:02:14.120217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 407/846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:13 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:14.401222 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-dcd05d2f-996f-43c3-81d7-db3ef65f6888 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:14.401825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-dcd05d2f-996f-43c3-81d7-db3ef65f6888 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:14.408124 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dcd05d2f-996f-43c3-81d7-db3ef65f6888 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:14.408633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dcd05d2f-996f-43c3-81d7-db3ef65f6888 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:14.409061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dcd05d2f-996f-43c3-81d7-db3ef65f6888 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:14.409738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dcd05d2f-996f-43c3-81d7-db3ef65f6888 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:14.410185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dcd05d2f-996f-43c3-81d7-db3ef65f6888 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:14.410603 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-dcd05d2f-996f-43c3-81d7-db3ef65f6888 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:14.538581 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-dcd05d2f-996f-43c3-81d7-db3ef65f6888 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:14.546168 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-dcd05d2f-996f-43c3-81d7-db3ef65f6888 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.149329 Aug 30 02:02:14.546722 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 440/847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:14 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:15.069088 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-d5cd9c65-af2d-4fcb-baf6-d3618cec23ef req-5f5149a6-23d4-4ff1-ad7d-ecb62f790448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65eab266-f475-47c5-98a1-070a67ff8e68", "name": "network-vif-deleted", "tag": "eb2a3763-3850-42a6-8a5c-6dde5552ec37"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:15.086806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-cf369748-e96c-4de0-8141-dd665d571d38 req-884aba80-9385-4006-a9e0-c1222a0ca307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e06f030-1187-44b2-bf6d-dfff52fbbc06", "name": "network-vif-plugged", "status": "completed", "tag": "0275d53a-fdb2-4036-b793-03c933bc3ad0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:15.087291 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-d5cd9c65-af2d-4fcb-baf6-d3618cec23ef req-5f5149a6-23d4-4ff1-ad7d-ecb62f790448 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:15.087968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-d5cd9c65-af2d-4fcb-baf6-d3618cec23ef req-5f5149a6-23d4-4ff1-ad7d-ecb62f790448 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:15.088488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-d5cd9c65-af2d-4fcb-baf6-d3618cec23ef req-5f5149a6-23d4-4ff1-ad7d-ecb62f790448 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:15.099238 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-cf369748-e96c-4de0-8141-dd665d571d38 req-884aba80-9385-4006-a9e0-c1222a0ca307 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:15.099782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-cf369748-e96c-4de0-8141-dd665d571d38 req-884aba80-9385-4006-a9e0-c1222a0ca307 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:15.100310 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-cf369748-e96c-4de0-8141-dd665d571d38 req-884aba80-9385-4006-a9e0-c1222a0ca307 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:15.103317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-d5cd9c65-af2d-4fcb-baf6-d3618cec23ef req-5f5149a6-23d4-4ff1-ad7d-ecb62f790448 service nova] Creating event network-vif-deleted:eb2a3763-3850-42a6-8a5c-6dde5552ec37 for instance 65eab266-f475-47c5-98a1-070a67ff8e68 on hv-cinder-81966 Aug 30 02:02:15.110003 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-d5cd9c65-af2d-4fcb-baf6-d3618cec23ef req-5f5149a6-23d4-4ff1-ad7d-ecb62f790448 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047205 Aug 30 02:02:15.111724 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 408/848] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:15.116873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-cf369748-e96c-4de0-8141-dd665d571d38 req-884aba80-9385-4006-a9e0-c1222a0ca307 service nova] Creating event network-vif-plugged:0275d53a-fdb2-4036-b793-03c933bc3ad0 for instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 on hv-cinder-81966 Aug 30 02:02:15.123108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-cf369748-e96c-4de0-8141-dd665d571d38 req-884aba80-9385-4006-a9e0-c1222a0ca307 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040540 Aug 30 02:02:15.123983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 441/849] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:02:15.140654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1039214f-9ec7-407c-bd69-803dbc634df0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:15.141345 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1039214f-9ec7-407c-bd69-803dbc634df0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:15.147995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1039214f-9ec7-407c-bd69-803dbc634df0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:15.148532 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1039214f-9ec7-407c-bd69-803dbc634df0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:15.148968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1039214f-9ec7-407c-bd69-803dbc634df0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:15.149701 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1039214f-9ec7-407c-bd69-803dbc634df0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:15.150329 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1039214f-9ec7-407c-bd69-803dbc634df0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:15.150747 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1039214f-9ec7-407c-bd69-803dbc634df0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:15.223290 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1039214f-9ec7-407c-bd69-803dbc634df0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:15.232442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1039214f-9ec7-407c-bd69-803dbc634df0 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1303 microversion: 2.1 time: 0.095872 Aug 30 02:02:15.232995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 409/850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:15 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:15.567855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-32d6b0af-4cb2-4f39-b69c-f79594a0452c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:15.568616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-32d6b0af-4cb2-4f39-b69c-f79594a0452c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:15.575142 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32d6b0af-4cb2-4f39-b69c-f79594a0452c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:15.575623 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32d6b0af-4cb2-4f39-b69c-f79594a0452c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:15.576053 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32d6b0af-4cb2-4f39-b69c-f79594a0452c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:15.576765 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32d6b0af-4cb2-4f39-b69c-f79594a0452c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:15.577218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32d6b0af-4cb2-4f39-b69c-f79594a0452c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:15.577640 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32d6b0af-4cb2-4f39-b69c-f79594a0452c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:15.705834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6399eef8-ce8d-45fb-8995-e3d13bcac325 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:15.706610 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6399eef8-ce8d-45fb-8995-e3d13bcac325 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:15.712925 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-32d6b0af-4cb2-4f39-b69c-f79594a0452c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:15.715179 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6399eef8-ce8d-45fb-8995-e3d13bcac325 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:15.715897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6399eef8-ce8d-45fb-8995-e3d13bcac325 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:15.716593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6399eef8-ce8d-45fb-8995-e3d13bcac325 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:15.717505 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6399eef8-ce8d-45fb-8995-e3d13bcac325 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:15.718151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6399eef8-ce8d-45fb-8995-e3d13bcac325 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:15.718769 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6399eef8-ce8d-45fb-8995-e3d13bcac325 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:15.720919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-32d6b0af-4cb2-4f39-b69c-f79594a0452c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.157480 Aug 30 02:02:15.732347 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 442/851] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:15 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:15.755174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-6399eef8-ce8d-45fb-8995-e3d13bcac325 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lazy-loading 'flavor' on Instance uuid b5ee86d8-d269-493f-a24a-32c664d277d9 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:02:15.861137 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6399eef8-ce8d-45fb-8995-e3d13bcac325 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "POST /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9/action" status: 202 len: 0 microversion: 2.1 time: 0.258438 Aug 30 02:02:15.861718 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 410/852] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:02:15 2022] POST /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:02:15.869947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c527f78f-4394-4acf-80ff-404ef7cc7e18 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:15.870575 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c527f78f-4394-4acf-80ff-404ef7cc7e18 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:15.876375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c527f78f-4394-4acf-80ff-404ef7cc7e18 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:15.876848 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c527f78f-4394-4acf-80ff-404ef7cc7e18 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:15.877275 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c527f78f-4394-4acf-80ff-404ef7cc7e18 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:15.877951 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c527f78f-4394-4acf-80ff-404ef7cc7e18 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:15.878401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c527f78f-4394-4acf-80ff-404ef7cc7e18 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:15.878820 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c527f78f-4394-4acf-80ff-404ef7cc7e18 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:16.006232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c527f78f-4394-4acf-80ff-404ef7cc7e18 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:16.014103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c527f78f-4394-4acf-80ff-404ef7cc7e18 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.148059 Aug 30 02:02:16.014654 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 443/853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:15 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:16.254717 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:16.255958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:16.263483 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:16.263962 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:16.264428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:16.265116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:16.265567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:16.265990 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:16.299710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:16.300194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:16.300687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:16.301133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lazy-loading 'fault' on Instance uuid 65eab266-f475-47c5-98a1-070a67ff8e68 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:02:16.341643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:16.349086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f28f54da-5951-4342-9844-859103198f08 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1308 microversion: 2.1 time: 0.098703 Aug 30 02:02:16.349644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 411/854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:16 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:16.741584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d64b558c-3db0-40e3-9742-d431c6f3f120 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:16.742219 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d64b558c-3db0-40e3-9742-d431c6f3f120 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:16.748581 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64b558c-3db0-40e3-9742-d431c6f3f120 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:16.749058 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64b558c-3db0-40e3-9742-d431c6f3f120 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:16.749487 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64b558c-3db0-40e3-9742-d431c6f3f120 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:16.750167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64b558c-3db0-40e3-9742-d431c6f3f120 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:16.750613 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64b558c-3db0-40e3-9742-d431c6f3f120 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:16.751033 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d64b558c-3db0-40e3-9742-d431c6f3f120 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:16.878531 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d64b558c-3db0-40e3-9742-d431c6f3f120 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:16.886184 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d64b558c-3db0-40e3-9742-d431c6f3f120 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1264 microversion: 2.1 time: 0.148413 Aug 30 02:02:16.886732 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 444/855] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:16 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:17.034948 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-960571a2-0613-4b90-93a5-5e9ac050c1b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:17.035471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-960571a2-0613-4b90-93a5-5e9ac050c1b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:17.041841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-960571a2-0613-4b90-93a5-5e9ac050c1b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:17.042319 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-960571a2-0613-4b90-93a5-5e9ac050c1b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:17.042752 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-960571a2-0613-4b90-93a5-5e9ac050c1b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:17.043436 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-960571a2-0613-4b90-93a5-5e9ac050c1b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:17.043882 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-960571a2-0613-4b90-93a5-5e9ac050c1b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:17.044324 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-960571a2-0613-4b90-93a5-5e9ac050c1b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:17.177543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-960571a2-0613-4b90-93a5-5e9ac050c1b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:17.186424 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-960571a2-0613-4b90-93a5-5e9ac050c1b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.155389 Aug 30 02:02:17.187016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 412/856] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:17 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:17.369712 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:17.370344 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:17.376280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:17.376805 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:17.377237 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:17.377910 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:17.378359 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:17.378780 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:17.409054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:17.409520 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:17.409944 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:17.410377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lazy-loading 'fault' on Instance uuid 65eab266-f475-47c5-98a1-070a67ff8e68 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:02:17.456033 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0646d81951fa4353bdfb59048b498652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d07d38e84224c9282dea262e712e4e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:17.463450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7f67a858-7dc0-4d27-b2c4-e18984774b38 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 200 len: 1308 microversion: 2.1 time: 0.097591 Aug 30 02:02:17.464034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 445/857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:17 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:17.906912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-602f3f0c-cf66-4282-8d3b-006d73c5dd6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:17.907497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-602f3f0c-cf66-4282-8d3b-006d73c5dd6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:17.914931 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-602f3f0c-cf66-4282-8d3b-006d73c5dd6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:17.915419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-602f3f0c-cf66-4282-8d3b-006d73c5dd6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:17.915850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-602f3f0c-cf66-4282-8d3b-006d73c5dd6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:17.916880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-602f3f0c-cf66-4282-8d3b-006d73c5dd6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:17.917330 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-602f3f0c-cf66-4282-8d3b-006d73c5dd6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:17.917740 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-602f3f0c-cf66-4282-8d3b-006d73c5dd6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:18.045912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-602f3f0c-cf66-4282-8d3b-006d73c5dd6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:18.053571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-602f3f0c-cf66-4282-8d3b-006d73c5dd6f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1451 microversion: 2.1 time: 0.150558 Aug 30 02:02:18.054728 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 413/858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:17 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:18.074022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-660b17cd-4603-4fb6-aad1-9dc3c58524a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:18.074583 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-660b17cd-4603-4fb6-aad1-9dc3c58524a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:18.080836 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-660b17cd-4603-4fb6-aad1-9dc3c58524a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:18.081316 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-660b17cd-4603-4fb6-aad1-9dc3c58524a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:18.081735 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-660b17cd-4603-4fb6-aad1-9dc3c58524a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:18.082410 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-660b17cd-4603-4fb6-aad1-9dc3c58524a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:18.082854 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-660b17cd-4603-4fb6-aad1-9dc3c58524a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:18.083273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-660b17cd-4603-4fb6-aad1-9dc3c58524a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:18.207979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1e4db25e-3c58-4f19-bd65-7d902402bb05 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:18.208617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1e4db25e-3c58-4f19-bd65-7d902402bb05 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:18.212355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-660b17cd-4603-4fb6-aad1-9dc3c58524a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:18.214862 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1e4db25e-3c58-4f19-bd65-7d902402bb05 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:18.215341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1e4db25e-3c58-4f19-bd65-7d902402bb05 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:18.215768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1e4db25e-3c58-4f19-bd65-7d902402bb05 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:18.216480 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1e4db25e-3c58-4f19-bd65-7d902402bb05 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:18.216928 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1e4db25e-3c58-4f19-bd65-7d902402bb05 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:18.217341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1e4db25e-3c58-4f19-bd65-7d902402bb05 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:18.220574 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-660b17cd-4603-4fb6-aad1-9dc3c58524a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1451 microversion: 2.1 time: 0.150335 Aug 30 02:02:18.221140 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 446/859] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:18 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:18.347618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1e4db25e-3c58-4f19-bd65-7d902402bb05 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:18.355821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1e4db25e-3c58-4f19-bd65-7d902402bb05 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.151924 Aug 30 02:02:18.356608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 414/860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:18 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:18.483482 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:18.484169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] [instance: 65eab266-f475-47c5-98a1-070a67ff8e68] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:18.490150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:18.490712 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:18.491240 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:18.491941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:18.492431 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:18.492857 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:18.507075 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] HTTP exception thrown: Instance 65eab266-f475-47c5-98a1-070a67ff8e68 could not be found. Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Request method failure captured: Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 HTTP/1.1 Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW6119Y7Yh3IjThgPlOzkiTvKGNlaCuAmf9aECYIGP7v9nsu1K16U18iMWLTt985SiJiMZvdqFX3hxnNUar0C3rMRgUkaMeek0tOSxSrj0BMiV88315VqAB-4edNmQM5P0vpIvBFyogDbovc58D4Mb-Z_sH-3bbntquY65MXuhPB4QA Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 4d07d38e84224c9282dea262e712e4e3 Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1808045730 Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:02:18.508761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4d07d38e84224c9282dea262e712e4e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4d07d38e84224c9282dea262e712e4e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4d07d38e84224c9282dea262e712e4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4d07d38e84224c9282dea262e712e4e3"}]}] Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-VolumesSnapshotTestJSON-1808045730 Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 4d07d38e84224c9282dea262e712e4e3 Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1808045730 Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-VolumesSnapshotTestJSON-1808045730-project Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 0646d81951fa4353bdfb59048b498652 Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-VolumesSnapshotTestJSON-1808045730-project Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 65eab266-f475-47c5-98a1-070a67ff8e68 could not be found. Aug 30 02:02:18.510351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '65eab266-f475-47c5-98a1-070a67ff8e68'} Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65eab266-f475-47c5-98a1-070a67ff8e68 could not be found. Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:02:18.511180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65eab266-f475-47c5-98a1-070a67ff8e68 could not be found. Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65eab266-f475-47c5-98a1-070a67ff8e68 could not be found. Aug 30 02:02:18.512572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:02:18.513670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] Returning 404 to user: Instance 65eab266-f475-47c5-98a1-070a67ff8e68 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:02:18.513670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cf8c612e-7d64-4c59-a667-71208c45d622 tempest-VolumesSnapshotTestJSON-1808045730 tempest-VolumesSnapshotTestJSON-1808045730-project] 10.222.0.50 "GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68" status: 404 len: 111 microversion: 2.1 time: 0.030862 Aug 30 02:02:18.513670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 447/861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:18 2022] GET /compute/v2.1/servers/65eab266-f475-47c5-98a1-070a67ff8e68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:02:19.376687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aec1eae1-2f68-4489-8433-d46007af986e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:19.377337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-aec1eae1-2f68-4489-8433-d46007af986e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:19.384002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec1eae1-2f68-4489-8433-d46007af986e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:19.384516 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec1eae1-2f68-4489-8433-d46007af986e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:19.384956 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec1eae1-2f68-4489-8433-d46007af986e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:19.385663 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec1eae1-2f68-4489-8433-d46007af986e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:19.386106 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec1eae1-2f68-4489-8433-d46007af986e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:19.386558 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aec1eae1-2f68-4489-8433-d46007af986e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:19.745561 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aec1eae1-2f68-4489-8433-d46007af986e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:19.753202 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-aec1eae1-2f68-4489-8433-d46007af986e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.380358 Aug 30 02:02:19.753772 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 415/862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:19 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:20.108192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-34b77d65-d91c-4fd6-8bc3-d072b4c91c73 req-fa66cbe9-1734-4798-85f8-0a8ec6b49b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e06f030-1187-44b2-bf6d-dfff52fbbc06", "tag": "0275d53a-fdb2-4036-b793-03c933bc3ad0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:20.118973 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-34b77d65-d91c-4fd6-8bc3-d072b4c91c73 req-fa66cbe9-1734-4798-85f8-0a8ec6b49b77 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:20.119538 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-34b77d65-d91c-4fd6-8bc3-d072b4c91c73 req-fa66cbe9-1734-4798-85f8-0a8ec6b49b77 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:20.120049 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-34b77d65-d91c-4fd6-8bc3-d072b4c91c73 req-fa66cbe9-1734-4798-85f8-0a8ec6b49b77 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:20.131197 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-34b77d65-d91c-4fd6-8bc3-d072b4c91c73 req-fa66cbe9-1734-4798-85f8-0a8ec6b49b77 service nova] Creating event network-changed:0275d53a-fdb2-4036-b793-03c933bc3ad0 for instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 on hv-cinder-81966 Aug 30 02:02:20.136513 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-34b77d65-d91c-4fd6-8bc3-d072b4c91c73 req-fa66cbe9-1734-4798-85f8-0a8ec6b49b77 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032031 Aug 30 02:02:20.137099 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 448/863] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:20.775494 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-23380e24-75b4-4477-9dc8-4ec700a2dba3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:20.776127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-23380e24-75b4-4477-9dc8-4ec700a2dba3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:20.782802 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23380e24-75b4-4477-9dc8-4ec700a2dba3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:20.783288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23380e24-75b4-4477-9dc8-4ec700a2dba3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:20.783721 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23380e24-75b4-4477-9dc8-4ec700a2dba3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:20.784455 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23380e24-75b4-4477-9dc8-4ec700a2dba3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:20.784906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23380e24-75b4-4477-9dc8-4ec700a2dba3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:20.785327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-23380e24-75b4-4477-9dc8-4ec700a2dba3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:20.924109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-23380e24-75b4-4477-9dc8-4ec700a2dba3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:20.933942 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-23380e24-75b4-4477-9dc8-4ec700a2dba3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.162739 Aug 30 02:02:20.934629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 416/864] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:20 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:21.955869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-962e4365-4e8d-47b3-b1fa-450c7a705c93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:21.956598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-962e4365-4e8d-47b3-b1fa-450c7a705c93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:21.962991 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-962e4365-4e8d-47b3-b1fa-450c7a705c93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:21.963469 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-962e4365-4e8d-47b3-b1fa-450c7a705c93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:21.963901 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-962e4365-4e8d-47b3-b1fa-450c7a705c93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:21.964613 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-962e4365-4e8d-47b3-b1fa-450c7a705c93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:21.965068 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-962e4365-4e8d-47b3-b1fa-450c7a705c93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:21.965495 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-962e4365-4e8d-47b3-b1fa-450c7a705c93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:22.094879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-962e4365-4e8d-47b3-b1fa-450c7a705c93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:22.103112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-962e4365-4e8d-47b3-b1fa-450c7a705c93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.151914 Aug 30 02:02:22.103667 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 449/865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:21 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:23.124304 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8d819836-e623-43c9-848a-730ecf838923 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:23.124956 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8d819836-e623-43c9-848a-730ecf838923 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:23.132904 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d819836-e623-43c9-848a-730ecf838923 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:23.133460 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d819836-e623-43c9-848a-730ecf838923 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:23.133883 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d819836-e623-43c9-848a-730ecf838923 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:23.134574 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d819836-e623-43c9-848a-730ecf838923 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:23.135023 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d819836-e623-43c9-848a-730ecf838923 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:23.135436 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8d819836-e623-43c9-848a-730ecf838923 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:23.140501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:23.269323 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8d819836-e623-43c9-848a-730ecf838923 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:23.276995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8d819836-e623-43c9-848a-730ecf838923 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.156555 Aug 30 02:02:23.277544 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 417/866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:23 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:24.298250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-52d43af3-96bd-4bee-9b62-ce3cc85a3402 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:24.298857 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-52d43af3-96bd-4bee-9b62-ce3cc85a3402 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:24.305808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-96bd-4bee-9b62-ce3cc85a3402 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:24.306282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-96bd-4bee-9b62-ce3cc85a3402 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:24.306710 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-96bd-4bee-9b62-ce3cc85a3402 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:24.307391 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-96bd-4bee-9b62-ce3cc85a3402 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:24.307838 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-96bd-4bee-9b62-ce3cc85a3402 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:24.308293 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52d43af3-96bd-4bee-9b62-ce3cc85a3402 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:24.441191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-52d43af3-96bd-4bee-9b62-ce3cc85a3402 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:24.449408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-52d43af3-96bd-4bee-9b62-ce3cc85a3402 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.154947 Aug 30 02:02:24.449963 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 450/867] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:24 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:25.469776 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-33bccb8a-860f-48ab-a839-7d2925e54f07 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:25.470321 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-33bccb8a-860f-48ab-a839-7d2925e54f07 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:25.476771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33bccb8a-860f-48ab-a839-7d2925e54f07 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:25.477252 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33bccb8a-860f-48ab-a839-7d2925e54f07 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:25.477687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33bccb8a-860f-48ab-a839-7d2925e54f07 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:25.478372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33bccb8a-860f-48ab-a839-7d2925e54f07 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:25.478826 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33bccb8a-860f-48ab-a839-7d2925e54f07 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:25.479246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-33bccb8a-860f-48ab-a839-7d2925e54f07 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:25.605704 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-33bccb8a-860f-48ab-a839-7d2925e54f07 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:25.613278 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-33bccb8a-860f-48ab-a839-7d2925e54f07 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.147432 Aug 30 02:02:25.613826 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 418/868] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:25 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:26.633460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-33c5de78-f8e7-42a0-8ef1-45d3cd592a77 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:26.634070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-33c5de78-f8e7-42a0-8ef1-45d3cd592a77 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:26.636522 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:26.642298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-33c5de78-f8e7-42a0-8ef1-45d3cd592a77 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:26.642757 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-33c5de78-f8e7-42a0-8ef1-45d3cd592a77 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:26.643188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-33c5de78-f8e7-42a0-8ef1-45d3cd592a77 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:26.643871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-33c5de78-f8e7-42a0-8ef1-45d3cd592a77 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:26.644368 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-33c5de78-f8e7-42a0-8ef1-45d3cd592a77 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:26.644790 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-33c5de78-f8e7-42a0-8ef1-45d3cd592a77 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:26.776231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-33c5de78-f8e7-42a0-8ef1-45d3cd592a77 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:26.783873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-33c5de78-f8e7-42a0-8ef1-45d3cd592a77 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.154519 Aug 30 02:02:26.784450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 451/869] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:26 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:27.018919 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3843c595-920c-41ae-a15a-02bd88944efd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d88ed96e-b9a8-446e-9eab-99fddc1ddb5b"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:27.021464 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3843c595-920c-41ae-a15a-02bd88944efd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:27.028023 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3843c595-920c-41ae-a15a-02bd88944efd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:27.028634 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3843c595-920c-41ae-a15a-02bd88944efd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:27.029065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3843c595-920c-41ae-a15a-02bd88944efd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:27.029745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3843c595-920c-41ae-a15a-02bd88944efd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:27.030192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3843c595-920c-41ae-a15a-02bd88944efd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:27.030610 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3843c595-920c-41ae-a15a-02bd88944efd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:27.345343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3843c595-920c-41ae-a15a-02bd88944efd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427788 Aug 30 02:02:27.345942 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 419/870] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 02:02:26 2022] POST /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:27.805608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cb114ae3-2564-41d0-ba08-8d497bced6d3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:27.806110 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cb114ae3-2564-41d0-ba08-8d497bced6d3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:27.812424 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb114ae3-2564-41d0-ba08-8d497bced6d3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:27.812899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb114ae3-2564-41d0-ba08-8d497bced6d3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:27.813328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb114ae3-2564-41d0-ba08-8d497bced6d3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:27.814003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb114ae3-2564-41d0-ba08-8d497bced6d3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:27.814446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb114ae3-2564-41d0-ba08-8d497bced6d3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:27.814862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cb114ae3-2564-41d0-ba08-8d497bced6d3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:27.943672 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cb114ae3-2564-41d0-ba08-8d497bced6d3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:27.945873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:27.952846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cb114ae3-2564-41d0-ba08-8d497bced6d3 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.151875 Aug 30 02:02:27.953403 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 452/871] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:27 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:28.975683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8adcb007-2059-49c1-8e9f-18d2a32db41e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:28.976506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8adcb007-2059-49c1-8e9f-18d2a32db41e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:28.983838 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8adcb007-2059-49c1-8e9f-18d2a32db41e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:28.984354 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8adcb007-2059-49c1-8e9f-18d2a32db41e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:28.984786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8adcb007-2059-49c1-8e9f-18d2a32db41e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:28.985479 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8adcb007-2059-49c1-8e9f-18d2a32db41e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:28.985933 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8adcb007-2059-49c1-8e9f-18d2a32db41e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:28.986392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8adcb007-2059-49c1-8e9f-18d2a32db41e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:29.132343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8adcb007-2059-49c1-8e9f-18d2a32db41e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:29.141059 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8adcb007-2059-49c1-8e9f-18d2a32db41e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.170685 Aug 30 02:02:29.141611 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 420/872] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:28 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:30.161757 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ecafb449-adad-47f7-8c1b-1ba517bb01cf tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:30.162365 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ecafb449-adad-47f7-8c1b-1ba517bb01cf tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:30.170138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ecafb449-adad-47f7-8c1b-1ba517bb01cf tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:30.170611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ecafb449-adad-47f7-8c1b-1ba517bb01cf tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:30.171035 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ecafb449-adad-47f7-8c1b-1ba517bb01cf tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:30.171715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ecafb449-adad-47f7-8c1b-1ba517bb01cf tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:30.172158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ecafb449-adad-47f7-8c1b-1ba517bb01cf tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:30.172598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ecafb449-adad-47f7-8c1b-1ba517bb01cf tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:30.309785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ecafb449-adad-47f7-8c1b-1ba517bb01cf tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:30.317883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ecafb449-adad-47f7-8c1b-1ba517bb01cf tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.159866 Aug 30 02:02:30.318375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 453/873] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:30 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:31.339709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9b3fc815-590c-4913-8c53-c78a97d02b3c tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:31.340338 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9b3fc815-590c-4913-8c53-c78a97d02b3c tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:31.346517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b3fc815-590c-4913-8c53-c78a97d02b3c tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:31.346989 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b3fc815-590c-4913-8c53-c78a97d02b3c tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:31.347418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b3fc815-590c-4913-8c53-c78a97d02b3c tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:31.348085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b3fc815-590c-4913-8c53-c78a97d02b3c tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:31.348560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b3fc815-590c-4913-8c53-c78a97d02b3c tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:31.348975 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9b3fc815-590c-4913-8c53-c78a97d02b3c tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:31.477257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9b3fc815-590c-4913-8c53-c78a97d02b3c tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:31.484828 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9b3fc815-590c-4913-8c53-c78a97d02b3c tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.148941 Aug 30 02:02:31.485388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 421/874] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:31 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:32.506022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-85bd4c84-6551-4698-a3fe-214c98d99505 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:32.506627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-85bd4c84-6551-4698-a3fe-214c98d99505 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:32.513176 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85bd4c84-6551-4698-a3fe-214c98d99505 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:32.513650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85bd4c84-6551-4698-a3fe-214c98d99505 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:32.514076 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85bd4c84-6551-4698-a3fe-214c98d99505 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:32.514755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85bd4c84-6551-4698-a3fe-214c98d99505 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:32.515205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85bd4c84-6551-4698-a3fe-214c98d99505 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:32.515626 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85bd4c84-6551-4698-a3fe-214c98d99505 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:32.792747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-85bd4c84-6551-4698-a3fe-214c98d99505 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:32.801175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-85bd4c84-6551-4698-a3fe-214c98d99505 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.298930 Aug 30 02:02:32.801732 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 454/875] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:32 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:33.821595 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-81a339dd-2f69-4332-8608-e87538f3b22b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:33.822200 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-81a339dd-2f69-4332-8608-e87538f3b22b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:33.828638 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81a339dd-2f69-4332-8608-e87538f3b22b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:33.829116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81a339dd-2f69-4332-8608-e87538f3b22b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:33.829544 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81a339dd-2f69-4332-8608-e87538f3b22b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:33.830223 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81a339dd-2f69-4332-8608-e87538f3b22b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:33.830670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81a339dd-2f69-4332-8608-e87538f3b22b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:33.831091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-81a339dd-2f69-4332-8608-e87538f3b22b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:33.956648 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-81a339dd-2f69-4332-8608-e87538f3b22b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:33.964612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-81a339dd-2f69-4332-8608-e87538f3b22b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.146789 Aug 30 02:02:33.965171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 422/876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:33 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:34.986256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c18dcfd8-c11f-40e5-811f-5b3449716657 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:34.986862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c18dcfd8-c11f-40e5-811f-5b3449716657 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:34.993325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c18dcfd8-c11f-40e5-811f-5b3449716657 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:34.993808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c18dcfd8-c11f-40e5-811f-5b3449716657 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:34.994270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c18dcfd8-c11f-40e5-811f-5b3449716657 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:34.994955 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c18dcfd8-c11f-40e5-811f-5b3449716657 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:34.995405 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c18dcfd8-c11f-40e5-811f-5b3449716657 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:34.995826 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c18dcfd8-c11f-40e5-811f-5b3449716657 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:35.127656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c18dcfd8-c11f-40e5-811f-5b3449716657 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:35.135996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c18dcfd8-c11f-40e5-811f-5b3449716657 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.153639 Aug 30 02:02:35.136591 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 455/877] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:34 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:36.157398 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-92ec842d-0a48-461a-973a-944f266642a8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:36.157968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-92ec842d-0a48-461a-973a-944f266642a8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:36.164405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92ec842d-0a48-461a-973a-944f266642a8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:36.164885 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92ec842d-0a48-461a-973a-944f266642a8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:36.165318 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92ec842d-0a48-461a-973a-944f266642a8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:36.166002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92ec842d-0a48-461a-973a-944f266642a8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:36.166454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92ec842d-0a48-461a-973a-944f266642a8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:36.166876 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-92ec842d-0a48-461a-973a-944f266642a8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:36.297344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-92ec842d-0a48-461a-973a-944f266642a8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:36.305935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-92ec842d-0a48-461a-973a-944f266642a8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.152507 Aug 30 02:02:36.306496 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 423/878] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:36 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:37.327244 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2aa4b52a-f48f-4c21-b05e-3ac0d927f24e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:37.327855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2aa4b52a-f48f-4c21-b05e-3ac0d927f24e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:37.334183 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2aa4b52a-f48f-4c21-b05e-3ac0d927f24e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:37.334657 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2aa4b52a-f48f-4c21-b05e-3ac0d927f24e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:37.335085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2aa4b52a-f48f-4c21-b05e-3ac0d927f24e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:37.335763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2aa4b52a-f48f-4c21-b05e-3ac0d927f24e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:37.336211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2aa4b52a-f48f-4c21-b05e-3ac0d927f24e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:37.336650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2aa4b52a-f48f-4c21-b05e-3ac0d927f24e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:37.465458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2aa4b52a-f48f-4c21-b05e-3ac0d927f24e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:37.473208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2aa4b52a-f48f-4c21-b05e-3ac0d927f24e tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.149844 Aug 30 02:02:37.473749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 456/879] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:37 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:38.495042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-17ee2b29-0059-4b6c-9f37-b10ab3d9a024 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:38.495618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-17ee2b29-0059-4b6c-9f37-b10ab3d9a024 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:38.502136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17ee2b29-0059-4b6c-9f37-b10ab3d9a024 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:38.502607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17ee2b29-0059-4b6c-9f37-b10ab3d9a024 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:38.503029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17ee2b29-0059-4b6c-9f37-b10ab3d9a024 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:38.503704 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17ee2b29-0059-4b6c-9f37-b10ab3d9a024 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:38.504147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17ee2b29-0059-4b6c-9f37-b10ab3d9a024 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:38.504588 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-17ee2b29-0059-4b6c-9f37-b10ab3d9a024 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:38.637149 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-17ee2b29-0059-4b6c-9f37-b10ab3d9a024 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:38.644493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-17ee2b29-0059-4b6c-9f37-b10ab3d9a024 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.153803 Aug 30 02:02:38.645051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 424/880] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:38 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:39.665345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f6fe4e98-3819-4bb1-8aa0-c4eea0f67118 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:39.665883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f6fe4e98-3819-4bb1-8aa0-c4eea0f67118 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:39.672180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6fe4e98-3819-4bb1-8aa0-c4eea0f67118 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:39.672690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6fe4e98-3819-4bb1-8aa0-c4eea0f67118 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:39.673120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6fe4e98-3819-4bb1-8aa0-c4eea0f67118 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:39.673832 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6fe4e98-3819-4bb1-8aa0-c4eea0f67118 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:39.674283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6fe4e98-3819-4bb1-8aa0-c4eea0f67118 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:39.674701 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6fe4e98-3819-4bb1-8aa0-c4eea0f67118 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:39.805503 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f6fe4e98-3819-4bb1-8aa0-c4eea0f67118 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:39.813156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f6fe4e98-3819-4bb1-8aa0-c4eea0f67118 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.151740 Aug 30 02:02:39.813707 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 457/881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:39 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:40.153328 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f638d41c-f871-4af1-9e07-270a24e9d238 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:40.156083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f638d41c-f871-4af1-9e07-270a24e9d238 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:40.158643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=46 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:40.164291 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f638d41c-f871-4af1-9e07-270a24e9d238 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.164778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f638d41c-f871-4af1-9e07-270a24e9d238 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.165211 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f638d41c-f871-4af1-9e07-270a24e9d238 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.165908 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f638d41c-f871-4af1-9e07-270a24e9d238 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.166359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f638d41c-f871-4af1-9e07-270a24e9d238 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.166782 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f638d41c-f871-4af1-9e07-270a24e9d238 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.192134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-f638d41c-f871-4af1-9e07-270a24e9d238 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lazy-loading 'flavor' on Instance uuid 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:02:40.464768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f638d41c-f871-4af1-9e07-270a24e9d238 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/action" status: 200 len: 32 microversion: 2.1 time: 0.315626 Aug 30 02:02:40.465457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 425/882] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:02:40 2022] POST /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/action => generated 32 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:02:40.475916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d74333b6-19ba-4213-9cde-22b40b3751c1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:40.476681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d74333b6-19ba-4213-9cde-22b40b3751c1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:40.482708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d74333b6-19ba-4213-9cde-22b40b3751c1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.483185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d74333b6-19ba-4213-9cde-22b40b3751c1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.483612 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d74333b6-19ba-4213-9cde-22b40b3751c1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.484311 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d74333b6-19ba-4213-9cde-22b40b3751c1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.484764 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d74333b6-19ba-4213-9cde-22b40b3751c1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.485177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d74333b6-19ba-4213-9cde-22b40b3751c1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.613628 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d74333b6-19ba-4213-9cde-22b40b3751c1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:40.622372 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d74333b6-19ba-4213-9cde-22b40b3751c1 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.150734 Aug 30 02:02:40.622927 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 458/883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:40 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:40.835495 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d2f83db4-f4e1-49e3-ba51-8bf41cc8c855 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:40.836194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d2f83db4-f4e1-49e3-ba51-8bf41cc8c855 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:40.842337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f83db4-f4e1-49e3-ba51-8bf41cc8c855 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.842821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f83db4-f4e1-49e3-ba51-8bf41cc8c855 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.843256 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f83db4-f4e1-49e3-ba51-8bf41cc8c855 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.843956 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f83db4-f4e1-49e3-ba51-8bf41cc8c855 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.844438 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f83db4-f4e1-49e3-ba51-8bf41cc8c855 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.844861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d2f83db4-f4e1-49e3-ba51-8bf41cc8c855 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.982082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d2f83db4-f4e1-49e3-ba51-8bf41cc8c855 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:40.989746 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d2f83db4-f4e1-49e3-ba51-8bf41cc8c855 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.158885 Aug 30 02:02:40.990287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 426/884] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:40 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:41.643622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1f87e080-0bf5-495a-b202-3267e8a27a13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:41.644234 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1f87e080-0bf5-495a-b202-3267e8a27a13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:41.650614 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f87e080-0bf5-495a-b202-3267e8a27a13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:41.651098 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f87e080-0bf5-495a-b202-3267e8a27a13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:41.651530 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f87e080-0bf5-495a-b202-3267e8a27a13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:41.652224 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f87e080-0bf5-495a-b202-3267e8a27a13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:41.652728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f87e080-0bf5-495a-b202-3267e8a27a13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:41.653153 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1f87e080-0bf5-495a-b202-3267e8a27a13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:41.855936 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1f87e080-0bf5-495a-b202-3267e8a27a13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:41.866632 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1f87e080-0bf5-495a-b202-3267e8a27a13 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.226307 Aug 30 02:02:41.867208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 459/885] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:41 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:42.010935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ba65b97a-6f73-48b6-b67f-27187e58212a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:42.011548 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ba65b97a-6f73-48b6-b67f-27187e58212a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:42.017880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba65b97a-6f73-48b6-b67f-27187e58212a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:42.018362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba65b97a-6f73-48b6-b67f-27187e58212a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:42.018797 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba65b97a-6f73-48b6-b67f-27187e58212a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:42.019481 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba65b97a-6f73-48b6-b67f-27187e58212a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:42.019937 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba65b97a-6f73-48b6-b67f-27187e58212a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:42.020384 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ba65b97a-6f73-48b6-b67f-27187e58212a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:42.150983 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ba65b97a-6f73-48b6-b67f-27187e58212a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:42.158732 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ba65b97a-6f73-48b6-b67f-27187e58212a tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.152401 Aug 30 02:02:42.159294 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 427/886] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:42 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:42.893500 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-046d921e-e964-4a02-af05-8eb2ec787e5e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:42.894453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-046d921e-e964-4a02-af05-8eb2ec787e5e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:42.901240 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-046d921e-e964-4a02-af05-8eb2ec787e5e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:42.901843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-046d921e-e964-4a02-af05-8eb2ec787e5e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:42.902286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-046d921e-e964-4a02-af05-8eb2ec787e5e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:42.902992 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-046d921e-e964-4a02-af05-8eb2ec787e5e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:42.903446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-046d921e-e964-4a02-af05-8eb2ec787e5e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:42.903870 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-046d921e-e964-4a02-af05-8eb2ec787e5e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.129134 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-046d921e-e964-4a02-af05-8eb2ec787e5e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:43.138122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-046d921e-e964-4a02-af05-8eb2ec787e5e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.253008 Aug 30 02:02:43.138730 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 460/887] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:42 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:43.180750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b9aa612e-2750-4231-a642-be019398f6f8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:43.181380 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b9aa612e-2750-4231-a642-be019398f6f8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:43.187882 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9aa612e-2750-4231-a642-be019398f6f8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.188400 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9aa612e-2750-4231-a642-be019398f6f8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.188833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9aa612e-2750-4231-a642-be019398f6f8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.189524 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9aa612e-2750-4231-a642-be019398f6f8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.189975 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9aa612e-2750-4231-a642-be019398f6f8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.190395 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9aa612e-2750-4231-a642-be019398f6f8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.320518 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b9aa612e-2750-4231-a642-be019398f6f8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:43.328779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b9aa612e-2750-4231-a642-be019398f6f8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1510 microversion: 2.1 time: 0.152505 Aug 30 02:02:43.329339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 428/888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:43 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:43.352930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-303fa5b5-32e5-40a1-95e0-e8aab31ef652 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:43.353602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-303fa5b5-32e5-40a1-95e0-e8aab31ef652 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:43.359883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-303fa5b5-32e5-40a1-95e0-e8aab31ef652 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.360412 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-303fa5b5-32e5-40a1-95e0-e8aab31ef652 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.360848 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-303fa5b5-32e5-40a1-95e0-e8aab31ef652 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.361542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-303fa5b5-32e5-40a1-95e0-e8aab31ef652 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.361992 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-303fa5b5-32e5-40a1-95e0-e8aab31ef652 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.362413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-303fa5b5-32e5-40a1-95e0-e8aab31ef652 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.392017 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-303fa5b5-32e5-40a1-95e0-e8aab31ef652 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120391) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 02:02:43.463946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-303fa5b5-32e5-40a1-95e0-e8aab31ef652 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "POST /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9/action" status: 202 len: 0 microversion: 2.1 time: 0.118016 Aug 30 02:02:43.464579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 461/889] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:02:43 2022] POST /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:02:43.472858 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cef4b03c-7881-42d2-85f4-04e5b4a6a8c8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:43.473793 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cef4b03c-7881-42d2-85f4-04e5b4a6a8c8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:43.479400 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cef4b03c-7881-42d2-85f4-04e5b4a6a8c8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.479873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cef4b03c-7881-42d2-85f4-04e5b4a6a8c8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.480320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cef4b03c-7881-42d2-85f4-04e5b4a6a8c8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.481007 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cef4b03c-7881-42d2-85f4-04e5b4a6a8c8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.481981 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cef4b03c-7881-42d2-85f4-04e5b4a6a8c8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.482471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cef4b03c-7881-42d2-85f4-04e5b4a6a8c8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.618662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cef4b03c-7881-42d2-85f4-04e5b4a6a8c8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:43.626687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cef4b03c-7881-42d2-85f4-04e5b4a6a8c8 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1518 microversion: 2.1 time: 0.157713 Aug 30 02:02:43.627245 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 429/890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:43 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:44.159327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-590d1b34-7224-4a65-9693-431485104ae2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:44.159869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-590d1b34-7224-4a65-9693-431485104ae2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:44.166745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-590d1b34-7224-4a65-9693-431485104ae2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.167227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-590d1b34-7224-4a65-9693-431485104ae2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.167660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-590d1b34-7224-4a65-9693-431485104ae2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.168382 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-590d1b34-7224-4a65-9693-431485104ae2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.168837 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-590d1b34-7224-4a65-9693-431485104ae2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.169262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-590d1b34-7224-4a65-9693-431485104ae2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.309489 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-590d1b34-7224-4a65-9693-431485104ae2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:44.317826 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-590d1b34-7224-4a65-9693-431485104ae2 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.162611 Aug 30 02:02:44.318394 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 462/891] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:44 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:44.648996 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2f035a58-73f6-4f40-b431-711cf46656b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:44.649579 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2f035a58-73f6-4f40-b431-711cf46656b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:44.656013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f035a58-73f6-4f40-b431-711cf46656b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.656534 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f035a58-73f6-4f40-b431-711cf46656b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.656968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f035a58-73f6-4f40-b431-711cf46656b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.657659 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f035a58-73f6-4f40-b431-711cf46656b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.658110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f035a58-73f6-4f40-b431-711cf46656b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.658533 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f035a58-73f6-4f40-b431-711cf46656b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.676968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:44.794487 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2f035a58-73f6-4f40-b431-711cf46656b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:44.803050 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2f035a58-73f6-4f40-b431-711cf46656b6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1520 microversion: 2.1 time: 0.158864 Aug 30 02:02:44.803638 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 430/892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:44 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:45.127533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-38ab6e49-6905-48a8-9eb1-f36d8670b377 req-dabefcba-3116-4fcb-9298-6c327b8701e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ee86d8-d269-493f-a24a-32c664d277d9", "name": "network-vif-unplugged", "status": "completed", "tag": "f1dd3161-ede7-45be-a32c-472d4a0a6a58"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:45.141256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-38ab6e49-6905-48a8-9eb1-f36d8670b377 req-dabefcba-3116-4fcb-9298-6c327b8701e5 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:45.141745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-38ab6e49-6905-48a8-9eb1-f36d8670b377 req-dabefcba-3116-4fcb-9298-6c327b8701e5 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:45.142181 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-38ab6e49-6905-48a8-9eb1-f36d8670b377 req-dabefcba-3116-4fcb-9298-6c327b8701e5 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:45.162894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.compute.server_external_events [req-38ab6e49-6905-48a8-9eb1-f36d8670b377 req-dabefcba-3116-4fcb-9298-6c327b8701e5 service nova] Unable to find a host for instance b5ee86d8-d269-493f-a24a-32c664d277d9. Dropping event network-vif-unplugged {{(pid=120391) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 02:02:45.164372 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-38ab6e49-6905-48a8-9eb1-f36d8670b377 req-dabefcba-3116-4fcb-9298-6c327b8701e5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041732 Aug 30 02:02:45.165211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 463/893] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 02:02:45.339005 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cc92443a-b6d5-48b6-aad5-4fb5677ef3bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:45.339616 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cc92443a-b6d5-48b6-aad5-4fb5677ef3bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:45.345614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc92443a-b6d5-48b6-aad5-4fb5677ef3bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:45.346097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc92443a-b6d5-48b6-aad5-4fb5677ef3bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:45.346540 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc92443a-b6d5-48b6-aad5-4fb5677ef3bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:45.347233 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc92443a-b6d5-48b6-aad5-4fb5677ef3bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:45.347688 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc92443a-b6d5-48b6-aad5-4fb5677ef3bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:45.348110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc92443a-b6d5-48b6-aad5-4fb5677ef3bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:45.480115 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cc92443a-b6d5-48b6-aad5-4fb5677ef3bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:45.488697 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cc92443a-b6d5-48b6-aad5-4fb5677ef3bc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.153554 Aug 30 02:02:45.489254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 431/894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:45 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:45.824280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5f86874d-48ee-4a33-938a-3399bfd6ff6f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:45.825569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5f86874d-48ee-4a33-938a-3399bfd6ff6f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:45.832893 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f86874d-48ee-4a33-938a-3399bfd6ff6f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:45.833517 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f86874d-48ee-4a33-938a-3399bfd6ff6f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:45.834031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f86874d-48ee-4a33-938a-3399bfd6ff6f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:45.834924 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f86874d-48ee-4a33-938a-3399bfd6ff6f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:45.835550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f86874d-48ee-4a33-938a-3399bfd6ff6f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:45.836137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f86874d-48ee-4a33-938a-3399bfd6ff6f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:45.980628 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5f86874d-48ee-4a33-938a-3399bfd6ff6f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:45.988194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5f86874d-48ee-4a33-938a-3399bfd6ff6f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.167830 Aug 30 02:02:45.988779 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 464/895] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:45 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:46.519859 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1faab5f6-1dda-4fd4-ba30-da58601f864e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:46.520511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1faab5f6-1dda-4fd4-ba30-da58601f864e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:46.527508 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1faab5f6-1dda-4fd4-ba30-da58601f864e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.527992 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1faab5f6-1dda-4fd4-ba30-da58601f864e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.528456 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1faab5f6-1dda-4fd4-ba30-da58601f864e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:46.529157 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1faab5f6-1dda-4fd4-ba30-da58601f864e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.529610 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1faab5f6-1dda-4fd4-ba30-da58601f864e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.530028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1faab5f6-1dda-4fd4-ba30-da58601f864e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:46.664522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1faab5f6-1dda-4fd4-ba30-da58601f864e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:46.672968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1faab5f6-1dda-4fd4-ba30-da58601f864e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.158732 Aug 30 02:02:46.673531 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 432/896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:46 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:47.009034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-412c138e-4d61-490a-a260-5d9678de5631 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:47.009710 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-412c138e-4d61-490a-a260-5d9678de5631 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:47.015980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-412c138e-4d61-490a-a260-5d9678de5631 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:47.016504 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-412c138e-4d61-490a-a260-5d9678de5631 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:47.016948 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-412c138e-4d61-490a-a260-5d9678de5631 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.017648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-412c138e-4d61-490a-a260-5d9678de5631 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:47.018108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-412c138e-4d61-490a-a260-5d9678de5631 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:47.018539 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-412c138e-4d61-490a-a260-5d9678de5631 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.151225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-412c138e-4d61-490a-a260-5d9678de5631 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:47.158903 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-412c138e-4d61-490a-a260-5d9678de5631 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.154578 Aug 30 02:02:47.159453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 465/897] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:47 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:47.694994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ea6129d6-3da7-4cd7-83a5-6cabe065b699 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:47.695663 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ea6129d6-3da7-4cd7-83a5-6cabe065b699 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:47.701974 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea6129d6-3da7-4cd7-83a5-6cabe065b699 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:47.702450 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea6129d6-3da7-4cd7-83a5-6cabe065b699 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:47.702881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea6129d6-3da7-4cd7-83a5-6cabe065b699 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.703560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea6129d6-3da7-4cd7-83a5-6cabe065b699 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:47.704013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea6129d6-3da7-4cd7-83a5-6cabe065b699 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:47.704461 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ea6129d6-3da7-4cd7-83a5-6cabe065b699 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.834335 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ea6129d6-3da7-4cd7-83a5-6cabe065b699 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:47.842938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ea6129d6-3da7-4cd7-83a5-6cabe065b699 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.151747 Aug 30 02:02:47.843492 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 433/898] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:47 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:48.180121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3e508a6e-a249-4ff6-8a0d-34c1ba062a72 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:48.180759 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3e508a6e-a249-4ff6-8a0d-34c1ba062a72 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:48.187139 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3e508a6e-a249-4ff6-8a0d-34c1ba062a72 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.187616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3e508a6e-a249-4ff6-8a0d-34c1ba062a72 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.188046 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3e508a6e-a249-4ff6-8a0d-34c1ba062a72 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.188841 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3e508a6e-a249-4ff6-8a0d-34c1ba062a72 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.189377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3e508a6e-a249-4ff6-8a0d-34c1ba062a72 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.189878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3e508a6e-a249-4ff6-8a0d-34c1ba062a72 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.354808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3e508a6e-a249-4ff6-8a0d-34c1ba062a72 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:48.362658 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3e508a6e-a249-4ff6-8a0d-34c1ba062a72 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.186345 Aug 30 02:02:48.363232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 466/899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:48 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:48.863859 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d70bc896-e336-4898-8473-1f339925d942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:48.864657 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d70bc896-e336-4898-8473-1f339925d942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:48.871245 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d70bc896-e336-4898-8473-1f339925d942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.871731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d70bc896-e336-4898-8473-1f339925d942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.872160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d70bc896-e336-4898-8473-1f339925d942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.872905 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d70bc896-e336-4898-8473-1f339925d942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.873345 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d70bc896-e336-4898-8473-1f339925d942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.873763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d70bc896-e336-4898-8473-1f339925d942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:49.006174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d70bc896-e336-4898-8473-1f339925d942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:49.015185 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d70bc896-e336-4898-8473-1f339925d942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.155240 Aug 30 02:02:49.015737 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 434/900] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:48 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:49.383130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9012b3a2-a9f4-410a-9c9f-1abd559465c6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:49.383738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9012b3a2-a9f4-410a-9c9f-1abd559465c6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:49.390019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9012b3a2-a9f4-410a-9c9f-1abd559465c6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:49.390496 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9012b3a2-a9f4-410a-9c9f-1abd559465c6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:49.390930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9012b3a2-a9f4-410a-9c9f-1abd559465c6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:49.391661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9012b3a2-a9f4-410a-9c9f-1abd559465c6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:49.392169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9012b3a2-a9f4-410a-9c9f-1abd559465c6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:49.392642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9012b3a2-a9f4-410a-9c9f-1abd559465c6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:49.536026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9012b3a2-a9f4-410a-9c9f-1abd559465c6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:49.544351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9012b3a2-a9f4-410a-9c9f-1abd559465c6 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.165162 Aug 30 02:02:49.544899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 467/901] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:49 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:50.036805 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-923188f0-289b-4f2e-9039-f1d97b4fcb1a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:50.037413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-923188f0-289b-4f2e-9039-f1d97b4fcb1a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:50.043903 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-923188f0-289b-4f2e-9039-f1d97b4fcb1a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:50.044418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-923188f0-289b-4f2e-9039-f1d97b4fcb1a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:50.044849 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-923188f0-289b-4f2e-9039-f1d97b4fcb1a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:50.045536 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-923188f0-289b-4f2e-9039-f1d97b4fcb1a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:50.045984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-923188f0-289b-4f2e-9039-f1d97b4fcb1a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:50.046404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-923188f0-289b-4f2e-9039-f1d97b4fcb1a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:50.192564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-923188f0-289b-4f2e-9039-f1d97b4fcb1a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:50.203721 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-923188f0-289b-4f2e-9039-f1d97b4fcb1a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.170812 Aug 30 02:02:50.204600 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 435/902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:50 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:50.565189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-589cd189-5e76-4a65-bc3b-47edecfd3934 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:50.566475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-589cd189-5e76-4a65-bc3b-47edecfd3934 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:50.573986 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-589cd189-5e76-4a65-bc3b-47edecfd3934 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:50.574474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-589cd189-5e76-4a65-bc3b-47edecfd3934 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:50.574910 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-589cd189-5e76-4a65-bc3b-47edecfd3934 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:50.575606 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-589cd189-5e76-4a65-bc3b-47edecfd3934 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:50.576066 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-589cd189-5e76-4a65-bc3b-47edecfd3934 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:50.576514 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-589cd189-5e76-4a65-bc3b-47edecfd3934 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:50.806078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-589cd189-5e76-4a65-bc3b-47edecfd3934 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:50.814041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-589cd189-5e76-4a65-bc3b-47edecfd3934 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.252775 Aug 30 02:02:50.814766 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 468/903] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:50 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:51.226154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ae32c76e-ce62-42c9-9342-67be2da1c2b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:51.226786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ae32c76e-ce62-42c9-9342-67be2da1c2b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:51.240362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae32c76e-ce62-42c9-9342-67be2da1c2b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.240859 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae32c76e-ce62-42c9-9342-67be2da1c2b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.241291 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae32c76e-ce62-42c9-9342-67be2da1c2b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.242573 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae32c76e-ce62-42c9-9342-67be2da1c2b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.243009 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae32c76e-ce62-42c9-9342-67be2da1c2b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.243428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae32c76e-ce62-42c9-9342-67be2da1c2b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.390804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ae32c76e-ce62-42c9-9342-67be2da1c2b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:51.401060 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ae32c76e-ce62-42c9-9342-67be2da1c2b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.178709 Aug 30 02:02:51.401722 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 436/904] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:51 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:51.836054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4e7d3cff-87b3-4451-be85-ee72cc283b5f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:51.836812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4e7d3cff-87b3-4451-be85-ee72cc283b5f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:51.843789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e7d3cff-87b3-4451-be85-ee72cc283b5f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.844293 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e7d3cff-87b3-4451-be85-ee72cc283b5f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.844920 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e7d3cff-87b3-4451-be85-ee72cc283b5f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.845623 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e7d3cff-87b3-4451-be85-ee72cc283b5f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.846107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e7d3cff-87b3-4451-be85-ee72cc283b5f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.846668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e7d3cff-87b3-4451-be85-ee72cc283b5f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.851022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:52.279419 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4e7d3cff-87b3-4451-be85-ee72cc283b5f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:52.304531 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4e7d3cff-87b3-4451-be85-ee72cc283b5f tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.472206 Aug 30 02:02:52.316465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 469/905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:51 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:52.423133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-64a9f342-586f-4452-8705-de8400695e16 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:52.423853 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-64a9f342-586f-4452-8705-de8400695e16 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:52.430802 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64a9f342-586f-4452-8705-de8400695e16 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:52.431372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64a9f342-586f-4452-8705-de8400695e16 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:52.431876 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64a9f342-586f-4452-8705-de8400695e16 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:52.432852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64a9f342-586f-4452-8705-de8400695e16 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:52.433384 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64a9f342-586f-4452-8705-de8400695e16 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:52.433924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-64a9f342-586f-4452-8705-de8400695e16 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:52.580823 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-64a9f342-586f-4452-8705-de8400695e16 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:52.589297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-64a9f342-586f-4452-8705-de8400695e16 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.170138 Aug 30 02:02:52.589852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 437/906] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:52 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:53.327879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9b792fc8-96b6-4787-a794-1843ea34ad3d tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:53.328630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9b792fc8-96b6-4787-a794-1843ea34ad3d tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:53.335307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b792fc8-96b6-4787-a794-1843ea34ad3d tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:53.336461 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b792fc8-96b6-4787-a794-1843ea34ad3d tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:53.337082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b792fc8-96b6-4787-a794-1843ea34ad3d tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:53.337795 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b792fc8-96b6-4787-a794-1843ea34ad3d tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:53.338280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b792fc8-96b6-4787-a794-1843ea34ad3d tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:53.338854 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9b792fc8-96b6-4787-a794-1843ea34ad3d tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:53.556229 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9b792fc8-96b6-4787-a794-1843ea34ad3d tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:53.564492 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9b792fc8-96b6-4787-a794-1843ea34ad3d tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.240650 Aug 30 02:02:53.565564 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 470/907] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:53 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:53.611324 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5690fd7e-8ea8-4ef2-9f65-4645b2d5a298 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:53.612017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5690fd7e-8ea8-4ef2-9f65-4645b2d5a298 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:53.618827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5690fd7e-8ea8-4ef2-9f65-4645b2d5a298 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:53.619325 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5690fd7e-8ea8-4ef2-9f65-4645b2d5a298 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:53.619953 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5690fd7e-8ea8-4ef2-9f65-4645b2d5a298 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:53.620926 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5690fd7e-8ea8-4ef2-9f65-4645b2d5a298 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:53.621388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5690fd7e-8ea8-4ef2-9f65-4645b2d5a298 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:53.621817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5690fd7e-8ea8-4ef2-9f65-4645b2d5a298 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:53.772582 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5690fd7e-8ea8-4ef2-9f65-4645b2d5a298 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:53.783485 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5690fd7e-8ea8-4ef2-9f65-4645b2d5a298 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.176392 Aug 30 02:02:53.797929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 438/908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:53 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:54.588382 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e6349da1-e678-47a0-87de-11f602b1b494 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:54.589714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e6349da1-e678-47a0-87de-11f602b1b494 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:54.598199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6349da1-e678-47a0-87de-11f602b1b494 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:54.598979 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6349da1-e678-47a0-87de-11f602b1b494 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:54.599554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6349da1-e678-47a0-87de-11f602b1b494 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:54.600633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6349da1-e678-47a0-87de-11f602b1b494 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:54.601342 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6349da1-e678-47a0-87de-11f602b1b494 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:54.602081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e6349da1-e678-47a0-87de-11f602b1b494 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:54.808938 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e6349da1-e678-47a0-87de-11f602b1b494 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:54.809717 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cc26f31d-4a7b-48d2-992c-cef3ea80e241 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:54.811205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cc26f31d-4a7b-48d2-992c-cef3ea80e241 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:54.817384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e6349da1-e678-47a0-87de-11f602b1b494 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.235127 Aug 30 02:02:54.817904 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc26f31d-4a7b-48d2-992c-cef3ea80e241 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:54.818406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 471/909] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:54 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:54.832358 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc26f31d-4a7b-48d2-992c-cef3ea80e241 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:54.832823 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc26f31d-4a7b-48d2-992c-cef3ea80e241 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:54.833574 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc26f31d-4a7b-48d2-992c-cef3ea80e241 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:54.834211 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc26f31d-4a7b-48d2-992c-cef3ea80e241 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:54.835089 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cc26f31d-4a7b-48d2-992c-cef3ea80e241 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:55.014123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cc26f31d-4a7b-48d2-992c-cef3ea80e241 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:55.025855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cc26f31d-4a7b-48d2-992c-cef3ea80e241 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.219609 Aug 30 02:02:55.026670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 439/910] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:54 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:55.838967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bb1a5ba3-8dd5-4353-abf8-9f68977a60aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:55.840473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bb1a5ba3-8dd5-4353-abf8-9f68977a60aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:55.847367 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bb1a5ba3-8dd5-4353-abf8-9f68977a60aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:55.848165 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bb1a5ba3-8dd5-4353-abf8-9f68977a60aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:55.848890 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bb1a5ba3-8dd5-4353-abf8-9f68977a60aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:55.849874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bb1a5ba3-8dd5-4353-abf8-9f68977a60aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:55.850626 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bb1a5ba3-8dd5-4353-abf8-9f68977a60aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:55.851587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bb1a5ba3-8dd5-4353-abf8-9f68977a60aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:56.044646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-bb1a5ba3-8dd5-4353-abf8-9f68977a60aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:56.046800 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1259327d-ad0d-4e77-9c9e-6093621ef338 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:56.047419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1259327d-ad0d-4e77-9c9e-6093621ef338 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:56.056532 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1259327d-ad0d-4e77-9c9e-6093621ef338 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:56.056790 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bb1a5ba3-8dd5-4353-abf8-9f68977a60aa tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.220665 Aug 30 02:02:56.057021 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1259327d-ad0d-4e77-9c9e-6093621ef338 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:56.057458 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1259327d-ad0d-4e77-9c9e-6093621ef338 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:56.057989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 472/911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:55 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:56.058241 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1259327d-ad0d-4e77-9c9e-6093621ef338 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:56.059109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1259327d-ad0d-4e77-9c9e-6093621ef338 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:56.059518 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1259327d-ad0d-4e77-9c9e-6093621ef338 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:56.341245 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1259327d-ad0d-4e77-9c9e-6093621ef338 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:56.350477 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1259327d-ad0d-4e77-9c9e-6093621ef338 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.307386 Aug 30 02:02:56.351055 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 440/912] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:56 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:57.080432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b4abd20d-b854-463e-8cbd-ba4c54272837 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:57.081051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b4abd20d-b854-463e-8cbd-ba4c54272837 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:57.083487 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:57.092593 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b4abd20d-b854-463e-8cbd-ba4c54272837 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:57.093082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b4abd20d-b854-463e-8cbd-ba4c54272837 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:57.093551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b4abd20d-b854-463e-8cbd-ba4c54272837 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:57.094236 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b4abd20d-b854-463e-8cbd-ba4c54272837 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:57.096978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b4abd20d-b854-463e-8cbd-ba4c54272837 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:57.100468 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b4abd20d-b854-463e-8cbd-ba4c54272837 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:57.377113 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-df301f54-b094-47f7-bbc2-d10f9a0e70e0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:57.378528 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-df301f54-b094-47f7-bbc2-d10f9a0e70e0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:57.386499 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df301f54-b094-47f7-bbc2-d10f9a0e70e0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:57.391855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df301f54-b094-47f7-bbc2-d10f9a0e70e0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:57.393664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df301f54-b094-47f7-bbc2-d10f9a0e70e0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:57.399219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df301f54-b094-47f7-bbc2-d10f9a0e70e0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:57.400145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df301f54-b094-47f7-bbc2-d10f9a0e70e0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:57.400370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b4abd20d-b854-463e-8cbd-ba4c54272837 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:57.400959 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df301f54-b094-47f7-bbc2-d10f9a0e70e0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:57.421864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b4abd20d-b854-463e-8cbd-ba4c54272837 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.345346 Aug 30 02:02:57.428781 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 473/913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:57 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:57.845049 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-df301f54-b094-47f7-bbc2-d10f9a0e70e0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:57.858839 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-df301f54-b094-47f7-bbc2-d10f9a0e70e0 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.484765 Aug 30 02:02:57.860136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 441/914] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:57 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:58.460027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-60ef3e35-e494-45e0-9723-5e2e0d39d1f4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:58.461425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-60ef3e35-e494-45e0-9723-5e2e0d39d1f4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:58.469494 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60ef3e35-e494-45e0-9723-5e2e0d39d1f4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:58.470005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60ef3e35-e494-45e0-9723-5e2e0d39d1f4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:58.470504 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60ef3e35-e494-45e0-9723-5e2e0d39d1f4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:58.471156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60ef3e35-e494-45e0-9723-5e2e0d39d1f4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:58.476076 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60ef3e35-e494-45e0-9723-5e2e0d39d1f4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:58.476970 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60ef3e35-e494-45e0-9723-5e2e0d39d1f4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:58.515379 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-3a8f558a-a59d-459e-a9b8-a4670ab95b56 req-12b98758-b309-41e8-be31-fc1b7039c8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ee86d8-d269-493f-a24a-32c664d277d9", "name": "network-vif-plugged", "status": "completed", "tag": "f1dd3161-ede7-45be-a32c-472d4a0a6a58"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:58.529511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3a8f558a-a59d-459e-a9b8-a4670ab95b56 req-12b98758-b309-41e8-be31-fc1b7039c8b7 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:58.530002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3a8f558a-a59d-459e-a9b8-a4670ab95b56 req-12b98758-b309-41e8-be31-fc1b7039c8b7 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:58.530430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3a8f558a-a59d-459e-a9b8-a4670ab95b56 req-12b98758-b309-41e8-be31-fc1b7039c8b7 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:58.551067 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-3a8f558a-a59d-459e-a9b8-a4670ab95b56 req-12b98758-b309-41e8-be31-fc1b7039c8b7 service nova] Creating event network-vif-plugged:f1dd3161-ede7-45be-a32c-472d4a0a6a58 for instance b5ee86d8-d269-493f-a24a-32c664d277d9 on hv-cinder-81966 Aug 30 02:02:58.557158 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-3a8f558a-a59d-459e-a9b8-a4670ab95b56 req-12b98758-b309-41e8-be31-fc1b7039c8b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047812 Aug 30 02:02:58.558044 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 442/915] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:58.658444 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-60ef3e35-e494-45e0-9723-5e2e0d39d1f4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:58.667914 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-60ef3e35-e494-45e0-9723-5e2e0d39d1f4 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.215060 Aug 30 02:02:58.668518 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 474/916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:58 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:58.881906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ad767eff-c24b-40b5-a5ee-bd9f5e3d4b0c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:58.883007 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ad767eff-c24b-40b5-a5ee-bd9f5e3d4b0c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:58.889860 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad767eff-c24b-40b5-a5ee-bd9f5e3d4b0c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:58.890674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad767eff-c24b-40b5-a5ee-bd9f5e3d4b0c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:58.891351 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad767eff-c24b-40b5-a5ee-bd9f5e3d4b0c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:58.892059 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad767eff-c24b-40b5-a5ee-bd9f5e3d4b0c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:58.892542 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad767eff-c24b-40b5-a5ee-bd9f5e3d4b0c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:58.892961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ad767eff-c24b-40b5-a5ee-bd9f5e3d4b0c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:59.121537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ad767eff-c24b-40b5-a5ee-bd9f5e3d4b0c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:59.141332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ad767eff-c24b-40b5-a5ee-bd9f5e3d4b0c tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.260173 Aug 30 02:02:59.141332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 443/917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:58 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:59.690609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1ca8eb1a-8ea6-453c-a21f-f1688d0828b2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:59.691839 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1ca8eb1a-8ea6-453c-a21f-f1688d0828b2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:59.699023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ca8eb1a-8ea6-453c-a21f-f1688d0828b2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:59.699688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ca8eb1a-8ea6-453c-a21f-f1688d0828b2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:59.700324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ca8eb1a-8ea6-453c-a21f-f1688d0828b2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:59.701196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ca8eb1a-8ea6-453c-a21f-f1688d0828b2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:59.701905 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ca8eb1a-8ea6-453c-a21f-f1688d0828b2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:59.709398 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ca8eb1a-8ea6-453c-a21f-f1688d0828b2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:59.994156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1ca8eb1a-8ea6-453c-a21f-f1688d0828b2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:00.005196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1ca8eb1a-8ea6-453c-a21f-f1688d0828b2 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.319385 Aug 30 02:03:00.019154 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 475/918] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:59 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:00.163079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-06d59084-26e4-43dd-a441-fe7407595265 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:00.163807 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-06d59084-26e4-43dd-a441-fe7407595265 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:00.170957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d59084-26e4-43dd-a441-fe7407595265 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:00.171504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d59084-26e4-43dd-a441-fe7407595265 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:00.171941 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d59084-26e4-43dd-a441-fe7407595265 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:00.172672 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d59084-26e4-43dd-a441-fe7407595265 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:00.173139 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d59084-26e4-43dd-a441-fe7407595265 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:00.173542 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d59084-26e4-43dd-a441-fe7407595265 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:00.337028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-06d59084-26e4-43dd-a441-fe7407595265 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:00.345902 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-06d59084-26e4-43dd-a441-fe7407595265 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.187600 Aug 30 02:03:00.347562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 444/919] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:00 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:01.027967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1b5b9155-c8b2-4771-ab91-00c167f14436 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:01.029256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1b5b9155-c8b2-4771-ab91-00c167f14436 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:01.039364 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 02:03:01.039850 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Tue Aug 30 02:03:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 (ip 10.222.0.50) !!! Aug 30 02:03:01.042949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1b5b9155-c8b2-4771-ab91-00c167f14436 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:01.043534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1b5b9155-c8b2-4771-ab91-00c167f14436 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:01.044053 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1b5b9155-c8b2-4771-ab91-00c167f14436 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:01.045038 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1b5b9155-c8b2-4771-ab91-00c167f14436 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:01.045852 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1b5b9155-c8b2-4771-ab91-00c167f14436 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:01.046382 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1b5b9155-c8b2-4771-ab91-00c167f14436 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:01.208738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1b5b9155-c8b2-4771-ab91-00c167f14436 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:01.219363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1b5b9155-c8b2-4771-ab91-00c167f14436 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.196479 Aug 30 02:03:01.224407 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 476/920] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:01 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:01.372503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-274e31c1-57c1-48d3-9d2f-5bcaf6b73568 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:01.373804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-274e31c1-57c1-48d3-9d2f-5bcaf6b73568 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:01.387004 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-274e31c1-57c1-48d3-9d2f-5bcaf6b73568 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:01.387895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-274e31c1-57c1-48d3-9d2f-5bcaf6b73568 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:01.403858 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-274e31c1-57c1-48d3-9d2f-5bcaf6b73568 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:01.408297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-274e31c1-57c1-48d3-9d2f-5bcaf6b73568 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:01.409205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-274e31c1-57c1-48d3-9d2f-5bcaf6b73568 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:01.409871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-274e31c1-57c1-48d3-9d2f-5bcaf6b73568 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:01.608688 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-274e31c1-57c1-48d3-9d2f-5bcaf6b73568 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:01.617588 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-274e31c1-57c1-48d3-9d2f-5bcaf6b73568 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1735 microversion: 2.1 time: 0.249940 Aug 30 02:03:01.618165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 445/921] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:01 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:02.245391 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-88bc5ee5-ad4c-4338-9ed7-96c8b5750d93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:02.246026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-88bc5ee5-ad4c-4338-9ed7-96c8b5750d93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:02.255418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-88bc5ee5-ad4c-4338-9ed7-96c8b5750d93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:02.255911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-88bc5ee5-ad4c-4338-9ed7-96c8b5750d93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:02.256386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-88bc5ee5-ad4c-4338-9ed7-96c8b5750d93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:02.257092 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-88bc5ee5-ad4c-4338-9ed7-96c8b5750d93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:02.258332 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-88bc5ee5-ad4c-4338-9ed7-96c8b5750d93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:02.258760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-88bc5ee5-ad4c-4338-9ed7-96c8b5750d93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:02.447734 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-88bc5ee5-ad4c-4338-9ed7-96c8b5750d93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:02.460969 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-88bc5ee5-ad4c-4338-9ed7-96c8b5750d93 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1576 microversion: 2.1 time: 0.219301 Aug 30 02:03:02.462324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 477/922] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:02 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:02.640720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cab3db53-7319-4ee8-85cb-d72a19b468ff tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:02.642094 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cab3db53-7319-4ee8-85cb-d72a19b468ff tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:02.648864 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cab3db53-7319-4ee8-85cb-d72a19b468ff tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:02.649360 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cab3db53-7319-4ee8-85cb-d72a19b468ff tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:02.649999 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cab3db53-7319-4ee8-85cb-d72a19b468ff tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:02.650759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cab3db53-7319-4ee8-85cb-d72a19b468ff tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:02.651149 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cab3db53-7319-4ee8-85cb-d72a19b468ff tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:02.651573 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cab3db53-7319-4ee8-85cb-d72a19b468ff tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:02.799718 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cab3db53-7319-4ee8-85cb-d72a19b468ff tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:02.808228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cab3db53-7319-4ee8-85cb-d72a19b468ff tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1715 microversion: 2.1 time: 0.171308 Aug 30 02:03:02.828851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 446/923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:02 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1715 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:02.960281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:02.960828 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:02.968402 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:02.968897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:02.969671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:02.970388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:02.971006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:02.971609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:03.081472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] HTTP exception thrown: Cannot 'detach_volume' instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c while it is in vm_state rescued Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Request method failure captured: Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: DELETE /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments/d88ed96e-b9a8-446e-9eab-99fddc1ddb5b HTTP/1.1 Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW6CH7rafVDf4Z49atCLViZ3JqK9FndKwadpATmAmjejXk-UMRbD6IDWbAEx9isb3LOGqCn3HFUiYljZOMTtY27lIE59l05A16SAbSpwxTuNaNf8VE8NsWO8DEt-mYiMRkVjGpfCnCmkLjQIxdO90EaVSI7HOs-2sZqlS7yDVykN_Iw Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 688f10cbc5ce42b895bb7a9285749cca Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:03:03.083218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_688f10cbc5ce42b895bb7a9285749cca"}]}] Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 688f10cbc5ce42b895bb7a9285749cca Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-ServerRescueNegativeTestJSON-108033553-project Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 86f364f03c7d4360b4a75ed194846ade Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-ServerRescueNegativeTestJSON-108033553-project Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:03:03.094888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Cannot 'detach_volume' instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c while it is in vm_state rescued Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'server_id': '5a9adad9-3583-4b2c-bb23-b55ab2c97b2c', 'id': 'd88ed96e-b9a8-446e-9eab-99fddc1ddb5b'} Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:03:03.096450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c while it is in vm_state rescued Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c while it is in vm_state rescued Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:03.098297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Returning 409 to user: Cannot 'detach_volume' instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c while it is in vm_state rescued {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:03:03.100141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-fde060e7-7b08-40eb-9639-18d1c44ace34 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments/d88ed96e-b9a8-446e-9eab-99fddc1ddb5b" status: 409 len: 152 microversion: 2.1 time: 0.128475 Aug 30 02:03:03.100141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 478/924] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:03:02 2022] DELETE /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments/d88ed96e-b9a8-446e-9eab-99fddc1ddb5b => generated 152 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 02:03:03.100638 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3292d91c-274f-429a-9064-719b2a561ae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:03.106352 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3292d91c-274f-429a-9064-719b2a561ae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:03.108372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3292d91c-274f-429a-9064-719b2a561ae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:03.109037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3292d91c-274f-429a-9064-719b2a561ae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:03.111741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3292d91c-274f-429a-9064-719b2a561ae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:03.111741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3292d91c-274f-429a-9064-719b2a561ae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:03.111741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3292d91c-274f-429a-9064-719b2a561ae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:03.112166 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3292d91c-274f-429a-9064-719b2a561ae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:03.156219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:03.201537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3292d91c-274f-429a-9064-719b2a561ae6 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "POST /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/action" status: 202 len: 0 microversion: 2.1 time: 0.107738 Aug 30 02:03:03.202854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 447/925] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:03:03 2022] POST /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:03:03.212021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cc219152-50ca-44e2-ab23-6acfcbf9dbfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:03.212708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cc219152-50ca-44e2-ab23-6acfcbf9dbfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:03.221681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc219152-50ca-44e2-ab23-6acfcbf9dbfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:03.222335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc219152-50ca-44e2-ab23-6acfcbf9dbfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:03.222942 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc219152-50ca-44e2-ab23-6acfcbf9dbfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:03.223838 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc219152-50ca-44e2-ab23-6acfcbf9dbfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:03.224477 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc219152-50ca-44e2-ab23-6acfcbf9dbfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:03.225708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cc219152-50ca-44e2-ab23-6acfcbf9dbfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:03.483299 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6883399e-f04c-473a-951e-0e10ef511651 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:03.484349 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6883399e-f04c-473a-951e-0e10ef511651 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:03.496631 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cc219152-50ca-44e2-ab23-6acfcbf9dbfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:03.508422 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6883399e-f04c-473a-951e-0e10ef511651 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:03.511977 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cc219152-50ca-44e2-ab23-6acfcbf9dbfc tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1723 microversion: 2.1 time: 0.304834 Aug 30 02:03:03.513687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6883399e-f04c-473a-951e-0e10ef511651 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:03.514339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6883399e-f04c-473a-951e-0e10ef511651 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:03.515291 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6883399e-f04c-473a-951e-0e10ef511651 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:03.515955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6883399e-f04c-473a-951e-0e10ef511651 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:03.521005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 479/926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:03 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:03.521811 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6883399e-f04c-473a-951e-0e10ef511651 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:03.777612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6883399e-f04c-473a-951e-0e10ef511651 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:03.788574 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6883399e-f04c-473a-951e-0e10ef511651 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1563 microversion: 2.1 time: 0.309542 Aug 30 02:03:03.803816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 448/927] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:03 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1563 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:04.540609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-661f9c9b-c4fc-4795-9011-4e8459f41e9e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:04.541873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-661f9c9b-c4fc-4795-9011-4e8459f41e9e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:04.550390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-661f9c9b-c4fc-4795-9011-4e8459f41e9e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:04.550970 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-661f9c9b-c4fc-4795-9011-4e8459f41e9e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:04.551489 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-661f9c9b-c4fc-4795-9011-4e8459f41e9e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:04.552287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-661f9c9b-c4fc-4795-9011-4e8459f41e9e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:04.552976 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-661f9c9b-c4fc-4795-9011-4e8459f41e9e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:04.553775 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-661f9c9b-c4fc-4795-9011-4e8459f41e9e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:04.719462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-661f9c9b-c4fc-4795-9011-4e8459f41e9e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:04.729935 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-661f9c9b-c4fc-4795-9011-4e8459f41e9e tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1723 microversion: 2.1 time: 0.194321 Aug 30 02:03:04.739169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 480/928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:04 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:05.751364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fe756b67-19cc-48ac-99c1-0f416aa9a6c8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:05.752759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fe756b67-19cc-48ac-99c1-0f416aa9a6c8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:05.763380 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe756b67-19cc-48ac-99c1-0f416aa9a6c8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:05.763996 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe756b67-19cc-48ac-99c1-0f416aa9a6c8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:05.764621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe756b67-19cc-48ac-99c1-0f416aa9a6c8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:05.765557 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe756b67-19cc-48ac-99c1-0f416aa9a6c8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:05.766112 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe756b67-19cc-48ac-99c1-0f416aa9a6c8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:05.766706 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe756b67-19cc-48ac-99c1-0f416aa9a6c8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:05.907521 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fe756b67-19cc-48ac-99c1-0f416aa9a6c8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:05.917897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fe756b67-19cc-48ac-99c1-0f416aa9a6c8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1723 microversion: 2.1 time: 0.168344 Aug 30 02:03:05.928298 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 449/929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:05 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:06.946352 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-eb183099-8971-430f-b534-07d4bb9764ae tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:06.947579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-eb183099-8971-430f-b534-07d4bb9764ae tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:06.954681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb183099-8971-430f-b534-07d4bb9764ae tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:06.955760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb183099-8971-430f-b534-07d4bb9764ae tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:06.956460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb183099-8971-430f-b534-07d4bb9764ae tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:06.957516 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb183099-8971-430f-b534-07d4bb9764ae tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:06.958175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb183099-8971-430f-b534-07d4bb9764ae tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:06.958945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb183099-8971-430f-b534-07d4bb9764ae tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:07.126733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-eb183099-8971-430f-b534-07d4bb9764ae tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:07.136490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-eb183099-8971-430f-b534-07d4bb9764ae tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1723 microversion: 2.1 time: 0.199583 Aug 30 02:03:07.151249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 481/930] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:06 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:08.160815 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0fc15cc1-af4f-4106-92f5-0a2e8c70b129 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:08.161352 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0fc15cc1-af4f-4106-92f5-0a2e8c70b129 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:08.168279 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0fc15cc1-af4f-4106-92f5-0a2e8c70b129 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:08.168791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0fc15cc1-af4f-4106-92f5-0a2e8c70b129 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:08.169230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0fc15cc1-af4f-4106-92f5-0a2e8c70b129 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:08.169928 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0fc15cc1-af4f-4106-92f5-0a2e8c70b129 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:08.170419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0fc15cc1-af4f-4106-92f5-0a2e8c70b129 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:08.170849 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0fc15cc1-af4f-4106-92f5-0a2e8c70b129 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:08.336294 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0fc15cc1-af4f-4106-92f5-0a2e8c70b129 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:08.345607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0fc15cc1-af4f-4106-92f5-0a2e8c70b129 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1729 microversion: 2.1 time: 0.188917 Aug 30 02:03:08.346275 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 450/931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:08 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:08.366421 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-352d49f9-f222-4e6f-8876-6200dd3716a4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:08.367490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-352d49f9-f222-4e6f-8876-6200dd3716a4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:08.373913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-352d49f9-f222-4e6f-8876-6200dd3716a4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:08.374396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-352d49f9-f222-4e6f-8876-6200dd3716a4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:08.374834 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-352d49f9-f222-4e6f-8876-6200dd3716a4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:08.375715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-352d49f9-f222-4e6f-8876-6200dd3716a4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:08.376177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-352d49f9-f222-4e6f-8876-6200dd3716a4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:08.376630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-352d49f9-f222-4e6f-8876-6200dd3716a4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:08.464966 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-352d49f9-f222-4e6f-8876-6200dd3716a4 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102347 Aug 30 02:03:08.465560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 482/932] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 02:03:08 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:08.992889 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f19e1b54-c836-48e2-a28c-db3d77f482df tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Action: 'create', calling method: .version_select at 0x7f3b08091160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-192436992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpZbYdGZfK9rHTZ9dGowl7aEfGzzZQxZFwVw+W8L0k63WpfXc0CJGfAsXLiTHGIZ9rzkR49MRgx5UIv8ZRDpwGYfxeV28dJ7O0wKHar2mZYk6js2BHbtrjcvr2fKiZN+w=="}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:09.008449 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-f19e1b54-c836-48e2-a28c-db3d77f482df tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Getting quotas for project 7351c123c59146cf80c23e0d1ffe80fb. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:03:09.012389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-f19e1b54-c836-48e2-a28c-db3d77f482df tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Getting quotas for user 6131a8d2e9374070bc770270c7a70519 and project 7351c123c59146cf80c23e0d1ffe80fb. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:03:09.034293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f19e1b54-c836-48e2-a28c-db3d77f482df tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045877 Aug 30 02:03:09.034968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 451/933] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 02:03:08 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:09.086353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1417658375", "imageRef": "a5fe69c0-41d5-4da7-b57a-385f2a3a5866", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-192436992", "networks": [{"uuid": "1c165d80-2288-4e9b-826d-2eedb70ac0c8"}]}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:09.140025 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.network.neutron [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] validate_networks() for [('1c165d80-2288-4e9b-826d-2eedb70ac0c8', None, None, None, None, None)] {{(pid=120391) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:03:09.514257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-da49502b-17d0-4e8a-a143-9227b2af0b41 req-8731b7d8-b159-4269-bfb4-052ebbd0f961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9adad9-3583-4b2c-bb23-b55ab2c97b2c", "tag": "23743ca1-3a9e-4a05-9026-c437ca9a2dec"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:09.525392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-da49502b-17d0-4e8a-a143-9227b2af0b41 req-8731b7d8-b159-4269-bfb4-052ebbd0f961 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:09.526103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-da49502b-17d0-4e8a-a143-9227b2af0b41 req-8731b7d8-b159-4269-bfb4-052ebbd0f961 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:09.526684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-da49502b-17d0-4e8a-a143-9227b2af0b41 req-8731b7d8-b159-4269-bfb4-052ebbd0f961 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:09.530578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Flavor limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:03:09.532207 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Image limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:03:09.532839 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Flavor pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:03:09.533352 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Image pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:03:09.533878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:03:09.538753 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-da49502b-17d0-4e8a-a143-9227b2af0b41 req-8731b7d8-b159-4269-bfb4-052ebbd0f961 service nova] Creating event network-changed:23743ca1-3a9e-4a05-9026-c437ca9a2dec for instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c on hv-cinder-81966 Aug 30 02:03:09.543856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:09.544012 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-da49502b-17d0-4e8a-a143-9227b2af0b41 req-8731b7d8-b159-4269-bfb4-052ebbd0f961 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175323 Aug 30 02:03:09.544479 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 452/934] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:09.544790 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:09.545330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:09.546231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:09.547051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:09.547611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:09.564610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Getting quotas for project 7351c123c59146cf80c23e0d1ffe80fb. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:03:09.568685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Getting quotas for user 6131a8d2e9374070bc770270c7a70519 and project 7351c123c59146cf80c23e0d1ffe80fb. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:03:09.580081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Going to run 1 instances... {{(pid=120391) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:03:09.582438 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5fe69c0-41d5-4da7-b57a-385f2a3a5866',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:03:09.633141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9e00072f-a155-4eeb-8d1d-409694efc6c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550040 Aug 30 02:03:09.633363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 483/935] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 02:03:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:03:09.655362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ea002499-a9a7-40a9-845b-6f7add5d6783 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:09.656162 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ea002499-a9a7-40a9-845b-6f7add5d6783 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:09.727916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ea002499-a9a7-40a9-845b-6f7add5d6783 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:09.736633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ea002499-a9a7-40a9-845b-6f7add5d6783 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1258 microversion: 2.1 time: 0.093806 Aug 30 02:03:09.739109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 453/936] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:09 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1258 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:10.634979 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bba31fad-ab96-4138-8b05-9e0246179065 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:10.635551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bba31fad-ab96-4138-8b05-9e0246179065 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:10.642319 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bba31fad-ab96-4138-8b05-9e0246179065 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.642801 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bba31fad-ab96-4138-8b05-9e0246179065 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.643235 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bba31fad-ab96-4138-8b05-9e0246179065 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.643930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bba31fad-ab96-4138-8b05-9e0246179065 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.644545 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bba31fad-ab96-4138-8b05-9e0246179065 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.644907 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bba31fad-ab96-4138-8b05-9e0246179065 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.669148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bba31fad-ab96-4138-8b05-9e0246179065 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0/ips" status: 200 len: 148 microversion: 2.1 time: 0.038957 Aug 30 02:03:10.669719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 484/937] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 02:03:10 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:10.681484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13ce3103-585a-4205-84e3-1d93ffc48741"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:10.683832 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:10.685830 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:10.693741 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.694245 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.694693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.695420 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.695894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.696350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.756878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9ce6bd49-affb-40d6-858a-49b3afc3cf9c tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:10.757753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9ce6bd49-affb-40d6-858a-49b3afc3cf9c tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:10.763637 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9ce6bd49-affb-40d6-858a-49b3afc3cf9c tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.764107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9ce6bd49-affb-40d6-858a-49b3afc3cf9c tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.764582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9ce6bd49-affb-40d6-858a-49b3afc3cf9c tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.765273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9ce6bd49-affb-40d6-858a-49b3afc3cf9c tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.765723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9ce6bd49-affb-40d6-858a-49b3afc3cf9c tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.766142 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9ce6bd49-affb-40d6-858a-49b3afc3cf9c tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.790903 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Invalid volume: volume 13ce3103-585a-4205-84e3-1d93ffc48741 is already attached to instances: 22f76949-51c7-4027-bca6-70e517d28eec Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: POST /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0/os-volume_attachments HTTP/1.1 Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 74 Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:03:10.792804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {"volumeAttachment": {"volumeId": "13ce3103-585a-4205-84e3-1d93ffc48741"}} Aug 30 02:03:10.794333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Invalid volume: volume 13ce3103-585a-4205-84e3-1d93ffc48741 is already attached to instances: 22f76949-51c7-4027-bca6-70e517d28eec Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'server_id': '93f56e8b-8c6b-469a-a47d-40fb70a05cb0', 'body': {'volumeAttachment': {'volumeId': '13ce3103-585a-4205-84e3-1d93ffc48741'}}} Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 13ce3103-585a-4205-84e3-1d93ffc48741 is already attached to instances: 22f76949-51c7-4027-bca6-70e517d28eec Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:03:10.795181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 13ce3103-585a-4205-84e3-1d93ffc48741 is already attached to instances: 22f76949-51c7-4027-bca6-70e517d28eec Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:10.796590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:10.798011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:10.798011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:03:10.798011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:03:10.798011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 13ce3103-585a-4205-84e3-1d93ffc48741 is already attached to instances: 22f76949-51c7-4027-bca6-70e517d28eec Aug 30 02:03:10.798011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:03:10.798011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 400 to user: Invalid volume: volume 13ce3103-585a-4205-84e3-1d93ffc48741 is already attached to instances: 22f76949-51c7-4027-bca6-70e517d28eec {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:03:10.798011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-18e5997b-dc71-4351-9c92-ce9724ad76e6 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117328 Aug 30 02:03:10.798011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 454/938] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 02:03:10 2022] POST /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:03:10.803016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4ee026e5-2075-46b2-89e5-53762250295c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:10.803509 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4ee026e5-2075-46b2-89e5-53762250295c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:10.809586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ee026e5-2075-46b2-89e5-53762250295c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.810072 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ee026e5-2075-46b2-89e5-53762250295c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.810506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ee026e5-2075-46b2-89e5-53762250295c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.811202 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ee026e5-2075-46b2-89e5-53762250295c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.811679 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ee026e5-2075-46b2-89e5-53762250295c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.812107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4ee026e5-2075-46b2-89e5-53762250295c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.830275 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9ce6bd49-affb-40d6-858a-49b3afc3cf9c tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:10.838319 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9ce6bd49-affb-40d6-858a-49b3afc3cf9c tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1310 microversion: 2.1 time: 0.085399 Aug 30 02:03:10.838723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4ee026e5-2075-46b2-89e5-53762250295c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:03:10.838851 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 485/939] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:10 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:10.912497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4ee026e5-2075-46b2-89e5-53762250295c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 204 len: 0 microversion: 2.1 time: 0.112831 Aug 30 02:03:10.913284 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 455/940] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:03:10 2022] DELETE /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 02:03:10.922235 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-44956fba-bce6-4abd-ac21-94ae878629fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:10.922847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-44956fba-bce6-4abd-ac21-94ae878629fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:10.928849 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44956fba-bce6-4abd-ac21-94ae878629fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.929891 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44956fba-bce6-4abd-ac21-94ae878629fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.930373 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44956fba-bce6-4abd-ac21-94ae878629fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.931575 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44956fba-bce6-4abd-ac21-94ae878629fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.932370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44956fba-bce6-4abd-ac21-94ae878629fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.932846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44956fba-bce6-4abd-ac21-94ae878629fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:11.066364 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-44956fba-bce6-4abd-ac21-94ae878629fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:11.073966 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-44956fba-bce6-4abd-ac21-94ae878629fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1681 microversion: 2.1 time: 0.155592 Aug 30 02:03:11.074525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 486/941] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:10 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:11.558680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-a8eb6b54-23a8-4360-ac68-2cf449d7734f req-f9c781ea-44d3-43c2-a501-cd2ba3911f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9adad9-3583-4b2c-bb23-b55ab2c97b2c", "tag": "23743ca1-3a9e-4a05-9026-c437ca9a2dec"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:11.567925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a8eb6b54-23a8-4360-ac68-2cf449d7734f req-f9c781ea-44d3-43c2-a501-cd2ba3911f0f service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:11.568436 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a8eb6b54-23a8-4360-ac68-2cf449d7734f req-f9c781ea-44d3-43c2-a501-cd2ba3911f0f service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:11.568866 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-a8eb6b54-23a8-4360-ac68-2cf449d7734f req-f9c781ea-44d3-43c2-a501-cd2ba3911f0f service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:11.580154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-a8eb6b54-23a8-4360-ac68-2cf449d7734f req-f9c781ea-44d3-43c2-a501-cd2ba3911f0f service nova] Creating event network-changed:23743ca1-3a9e-4a05-9026-c437ca9a2dec for instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c on hv-cinder-81966 Aug 30 02:03:11.584878 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-a8eb6b54-23a8-4360-ac68-2cf449d7734f req-f9c781ea-44d3-43c2-a501-cd2ba3911f0f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030740 Aug 30 02:03:11.585431 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 456/942] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:11.858947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7a8d4107-09ae-4ec0-9211-5f4928d060d5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:11.859518 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7a8d4107-09ae-4ec0-9211-5f4928d060d5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:11.865852 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7a8d4107-09ae-4ec0-9211-5f4928d060d5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:11.866324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7a8d4107-09ae-4ec0-9211-5f4928d060d5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:11.866753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7a8d4107-09ae-4ec0-9211-5f4928d060d5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:11.867430 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7a8d4107-09ae-4ec0-9211-5f4928d060d5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:11.867880 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7a8d4107-09ae-4ec0-9211-5f4928d060d5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:11.868324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7a8d4107-09ae-4ec0-9211-5f4928d060d5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:11.870825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:11.928804 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7a8d4107-09ae-4ec0-9211-5f4928d060d5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:11.936996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7a8d4107-09ae-4ec0-9211-5f4928d060d5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1318 microversion: 2.1 time: 0.081901 Aug 30 02:03:11.937575 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 487/943] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:11 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1318 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:12.096017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-96e3db87-b1c7-4ccc-a394-2f8b261fa09c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:12.096744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-96e3db87-b1c7-4ccc-a394-2f8b261fa09c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:12.102936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96e3db87-b1c7-4ccc-a394-2f8b261fa09c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.103417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96e3db87-b1c7-4ccc-a394-2f8b261fa09c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.103856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96e3db87-b1c7-4ccc-a394-2f8b261fa09c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:12.104571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96e3db87-b1c7-4ccc-a394-2f8b261fa09c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.105023 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96e3db87-b1c7-4ccc-a394-2f8b261fa09c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.105444 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-96e3db87-b1c7-4ccc-a394-2f8b261fa09c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:12.231783 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-96e3db87-b1c7-4ccc-a394-2f8b261fa09c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:12.239410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-96e3db87-b1c7-4ccc-a394-2f8b261fa09c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1681 microversion: 2.1 time: 0.148099 Aug 30 02:03:12.239962 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 457/944] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:12 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:12.379378 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9d82be98-1745-467a-a96d-7eae17010b83 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:12.379866 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9d82be98-1745-467a-a96d-7eae17010b83 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:12.386642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d82be98-1745-467a-a96d-7eae17010b83 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.387115 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d82be98-1745-467a-a96d-7eae17010b83 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.387550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d82be98-1745-467a-a96d-7eae17010b83 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:12.388223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d82be98-1745-467a-a96d-7eae17010b83 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.388705 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d82be98-1745-467a-a96d-7eae17010b83 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.389126 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d82be98-1745-467a-a96d-7eae17010b83 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:12.466378 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-9d82be98-1745-467a-a96d-7eae17010b83 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lazy-loading 'services' on Instance uuid 1cf13980-f99e-4a83-9ec5-95e80147696b {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:03:12.536598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9d82be98-1745-467a-a96d-7eae17010b83 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/os-volume_attachments/e4b63aed-9e3c-4893-8b8a-031b74453822" status: 202 len: 0 microversion: 2.1 time: 0.160926 Aug 30 02:03:12.537185 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 488/945] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:03:12 2022] DELETE /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/os-volume_attachments/e4b63aed-9e3c-4893-8b8a-031b74453822 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:03:12.957454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-00be033a-3b53-44e8-959b-4f5e644b5105 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:12.958089 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-00be033a-3b53-44e8-959b-4f5e644b5105 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:12.964571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00be033a-3b53-44e8-959b-4f5e644b5105 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.964984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00be033a-3b53-44e8-959b-4f5e644b5105 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.965437 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00be033a-3b53-44e8-959b-4f5e644b5105 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:12.966116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00be033a-3b53-44e8-959b-4f5e644b5105 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.966561 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00be033a-3b53-44e8-959b-4f5e644b5105 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.966976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-00be033a-3b53-44e8-959b-4f5e644b5105 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:13.025937 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-00be033a-3b53-44e8-959b-4f5e644b5105 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:13.033680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-00be033a-3b53-44e8-959b-4f5e644b5105 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1316 microversion: 2.1 time: 0.080133 Aug 30 02:03:13.034237 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 458/946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:12 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1316 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:13.261685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7922275a-4d1e-4139-886e-8dc0c881fc97 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:13.262366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7922275a-4d1e-4139-886e-8dc0c881fc97 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:13.268464 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7922275a-4d1e-4139-886e-8dc0c881fc97 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:13.268941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7922275a-4d1e-4139-886e-8dc0c881fc97 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:13.269371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7922275a-4d1e-4139-886e-8dc0c881fc97 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:13.270052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7922275a-4d1e-4139-886e-8dc0c881fc97 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:13.270495 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7922275a-4d1e-4139-886e-8dc0c881fc97 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:13.270911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7922275a-4d1e-4139-886e-8dc0c881fc97 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:13.395852 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7922275a-4d1e-4139-886e-8dc0c881fc97 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:13.404026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7922275a-4d1e-4139-886e-8dc0c881fc97 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1681 microversion: 2.1 time: 0.147554 Aug 30 02:03:13.404616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 489/947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:13 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:14.055623 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-afd9bc97-5774-4ad6-93e2-980daccaaa71 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:14.056235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-afd9bc97-5774-4ad6-93e2-980daccaaa71 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:14.064054 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afd9bc97-5774-4ad6-93e2-980daccaaa71 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:14.069704 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afd9bc97-5774-4ad6-93e2-980daccaaa71 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:14.070157 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afd9bc97-5774-4ad6-93e2-980daccaaa71 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:14.070892 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afd9bc97-5774-4ad6-93e2-980daccaaa71 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:14.071341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afd9bc97-5774-4ad6-93e2-980daccaaa71 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:14.071764 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-afd9bc97-5774-4ad6-93e2-980daccaaa71 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:14.189361 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-afd9bc97-5774-4ad6-93e2-980daccaaa71 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:14.197145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-afd9bc97-5774-4ad6-93e2-980daccaaa71 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1316 microversion: 2.1 time: 0.145944 Aug 30 02:03:14.197854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 459/948] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:14 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1316 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:14.425538 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8c0a24d8-6866-415f-9b2b-a993bd875e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:14.426321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8c0a24d8-6866-415f-9b2b-a993bd875e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:14.439572 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c0a24d8-6866-415f-9b2b-a993bd875e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:14.440055 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c0a24d8-6866-415f-9b2b-a993bd875e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:14.442257 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c0a24d8-6866-415f-9b2b-a993bd875e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:14.443004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c0a24d8-6866-415f-9b2b-a993bd875e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:14.443459 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c0a24d8-6866-415f-9b2b-a993bd875e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:14.446610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8c0a24d8-6866-415f-9b2b-a993bd875e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:14.766202 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c0b73499-c47b-42fa-abdc-c7bddf8a100a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:14.776842 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0b73499-c47b-42fa-abdc-c7bddf8a100a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:14.779226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0b73499-c47b-42fa-abdc-c7bddf8a100a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:14.781000 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c0b73499-c47b-42fa-abdc-c7bddf8a100a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:14.832544 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c0b73499-c47b-42fa-abdc-c7bddf8a100a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Going to try to stop instance {{(pid=120392) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 02:03:14.839780 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8c0a24d8-6866-415f-9b2b-a993bd875e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:14.848800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8c0a24d8-6866-415f-9b2b-a993bd875e39 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1681 microversion: 2.1 time: 0.427307 Aug 30 02:03:14.852828 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 490/949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:14 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1681 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:14.949490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c0b73499-c47b-42fa-abdc-c7bddf8a100a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/action" status: 202 len: 0 microversion: 2.1 time: 0.187304 Aug 30 02:03:14.951029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 460/950] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:03:14 2022] POST /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:03:14.961696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9d8d4efd-2f87-44b2-acca-cf0938a1044a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:14.962634 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9d8d4efd-2f87-44b2-acca-cf0938a1044a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:14.971619 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d8d4efd-2f87-44b2-acca-cf0938a1044a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:14.972756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d8d4efd-2f87-44b2-acca-cf0938a1044a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:14.973437 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d8d4efd-2f87-44b2-acca-cf0938a1044a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:14.974390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d8d4efd-2f87-44b2-acca-cf0938a1044a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:14.975269 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d8d4efd-2f87-44b2-acca-cf0938a1044a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:14.975968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d8d4efd-2f87-44b2-acca-cf0938a1044a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.176228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9d8d4efd-2f87-44b2-acca-cf0938a1044a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:15.185683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9d8d4efd-2f87-44b2-acca-cf0938a1044a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.229469 Aug 30 02:03:15.186351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 491/951] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:14 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:15.221990 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0616510d-4a14-4159-88af-7957bc5411ff tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:15.222729 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0616510d-4a14-4159-88af-7957bc5411ff tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:15.229427 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0616510d-4a14-4159-88af-7957bc5411ff tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.230372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0616510d-4a14-4159-88af-7957bc5411ff tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.231051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0616510d-4a14-4159-88af-7957bc5411ff tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.231981 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0616510d-4a14-4159-88af-7957bc5411ff tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.232686 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0616510d-4a14-4159-88af-7957bc5411ff tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.233343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0616510d-4a14-4159-88af-7957bc5411ff tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.465168 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0616510d-4a14-4159-88af-7957bc5411ff tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:15.472831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0616510d-4a14-4159-88af-7957bc5411ff tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.255508 Aug 30 02:03:15.473673 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 461/952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:15 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:15.606150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-37c2cfc8-2742-41bf-aef3-0adaea120d8c req-f8e1e791-6caa-4171-9709-383b4334a397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f56e8b-8c6b-469a-a47d-40fb70a05cb0", "name": "network-vif-deleted", "tag": "c1a5815c-8f17-48df-ae71-427b9c4db05f"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:15.615864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-37c2cfc8-2742-41bf-aef3-0adaea120d8c req-f8e1e791-6caa-4171-9709-383b4334a397 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.616377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-37c2cfc8-2742-41bf-aef3-0adaea120d8c req-f8e1e791-6caa-4171-9709-383b4334a397 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.616839 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-37c2cfc8-2742-41bf-aef3-0adaea120d8c req-f8e1e791-6caa-4171-9709-383b4334a397 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.639560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-37c2cfc8-2742-41bf-aef3-0adaea120d8c req-f8e1e791-6caa-4171-9709-383b4334a397 service nova] Creating event network-vif-deleted:c1a5815c-8f17-48df-ae71-427b9c4db05f for instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 on hv-cinder-81966 Aug 30 02:03:15.644893 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-37c2cfc8-2742-41bf-aef3-0adaea120d8c req-f8e1e791-6caa-4171-9709-383b4334a397 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042659 Aug 30 02:03:15.649938 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 492/953] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:15.887003 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3ebfee5f-74ec-4e41-b0ab-bebaa68a0963 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:15.888150 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3ebfee5f-74ec-4e41-b0ab-bebaa68a0963 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:15.896109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ebfee5f-74ec-4e41-b0ab-bebaa68a0963 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.897072 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ebfee5f-74ec-4e41-b0ab-bebaa68a0963 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.897950 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ebfee5f-74ec-4e41-b0ab-bebaa68a0963 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.898842 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ebfee5f-74ec-4e41-b0ab-bebaa68a0963 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.899479 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ebfee5f-74ec-4e41-b0ab-bebaa68a0963 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.899900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ebfee5f-74ec-4e41-b0ab-bebaa68a0963 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.981144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3ebfee5f-74ec-4e41-b0ab-bebaa68a0963 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:15.993201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3ebfee5f-74ec-4e41-b0ab-bebaa68a0963 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.120822 Aug 30 02:03:15.994019 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 462/954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:15 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:16.209464 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-69fb6436-9b9b-4bca-9aa9-8b0a0fa45e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:16.210261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-69fb6436-9b9b-4bca-9aa9-8b0a0fa45e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:16.224026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69fb6436-9b9b-4bca-9aa9-8b0a0fa45e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:16.228079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69fb6436-9b9b-4bca-9aa9-8b0a0fa45e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:16.229335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69fb6436-9b9b-4bca-9aa9-8b0a0fa45e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:16.230738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69fb6436-9b9b-4bca-9aa9-8b0a0fa45e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:16.231213 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69fb6436-9b9b-4bca-9aa9-8b0a0fa45e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:16.231648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-69fb6436-9b9b-4bca-9aa9-8b0a0fa45e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:16.424008 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-69fb6436-9b9b-4bca-9aa9-8b0a0fa45e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:16.432649 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-69fb6436-9b9b-4bca-9aa9-8b0a0fa45e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.228449 Aug 30 02:03:16.434046 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 493/955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:16 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:16.495246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-af730735-1b25-460f-adfd-bfd54de25934 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:16.496169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-af730735-1b25-460f-adfd-bfd54de25934 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:16.503223 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af730735-1b25-460f-adfd-bfd54de25934 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:16.503841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af730735-1b25-460f-adfd-bfd54de25934 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:16.504401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af730735-1b25-460f-adfd-bfd54de25934 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:16.505217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af730735-1b25-460f-adfd-bfd54de25934 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:16.505766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af730735-1b25-460f-adfd-bfd54de25934 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:16.506422 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af730735-1b25-460f-adfd-bfd54de25934 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:16.681489 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-af730735-1b25-460f-adfd-bfd54de25934 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:16.693885 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-af730735-1b25-460f-adfd-bfd54de25934 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.203751 Aug 30 02:03:16.707098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 463/956] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:16 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:17.014436 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a7055523-7677-4ef3-a9ec-4043b8ebea10 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:17.015047 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a7055523-7677-4ef3-a9ec-4043b8ebea10 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:17.021861 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7055523-7677-4ef3-a9ec-4043b8ebea10 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:17.022350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7055523-7677-4ef3-a9ec-4043b8ebea10 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:17.022783 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7055523-7677-4ef3-a9ec-4043b8ebea10 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:17.024282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7055523-7677-4ef3-a9ec-4043b8ebea10 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:17.024896 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7055523-7677-4ef3-a9ec-4043b8ebea10 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:17.025489 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a7055523-7677-4ef3-a9ec-4043b8ebea10 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:17.106698 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a7055523-7677-4ef3-a9ec-4043b8ebea10 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:17.114510 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a7055523-7677-4ef3-a9ec-4043b8ebea10 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.103960 Aug 30 02:03:17.115073 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 494/957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:17 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:17.454599 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8fc02720-b824-4245-8a3f-ddde4cf596c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:17.455342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8fc02720-b824-4245-8a3f-ddde4cf596c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:17.462437 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fc02720-b824-4245-8a3f-ddde4cf596c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:17.462925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fc02720-b824-4245-8a3f-ddde4cf596c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:17.463358 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fc02720-b824-4245-8a3f-ddde4cf596c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:17.464052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fc02720-b824-4245-8a3f-ddde4cf596c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:17.464534 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fc02720-b824-4245-8a3f-ddde4cf596c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:17.464958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fc02720-b824-4245-8a3f-ddde4cf596c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:17.470223 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:17.614196 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8fc02720-b824-4245-8a3f-ddde4cf596c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:17.622395 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8fc02720-b824-4245-8a3f-ddde4cf596c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.171949 Aug 30 02:03:17.622950 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 464/958] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:17 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:17.715510 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-01283e6d-ccb8-46dc-9d88-9c3cafbcf920 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:17.716331 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-01283e6d-ccb8-46dc-9d88-9c3cafbcf920 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:17.723659 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01283e6d-ccb8-46dc-9d88-9c3cafbcf920 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:17.724176 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01283e6d-ccb8-46dc-9d88-9c3cafbcf920 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:17.724592 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01283e6d-ccb8-46dc-9d88-9c3cafbcf920 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:17.725294 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01283e6d-ccb8-46dc-9d88-9c3cafbcf920 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:17.725738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01283e6d-ccb8-46dc-9d88-9c3cafbcf920 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:17.726940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-01283e6d-ccb8-46dc-9d88-9c3cafbcf920 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:17.866141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-01283e6d-ccb8-46dc-9d88-9c3cafbcf920 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:17.874098 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-01283e6d-ccb8-46dc-9d88-9c3cafbcf920 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.162704 Aug 30 02:03:17.874849 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 495/959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:17 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:18.137344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-170b51ee-3d66-42ce-8294-ca5ceffbdc1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:18.137879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-170b51ee-3d66-42ce-8294-ca5ceffbdc1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:18.143891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-170b51ee-3d66-42ce-8294-ca5ceffbdc1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:18.144386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-170b51ee-3d66-42ce-8294-ca5ceffbdc1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:18.144822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-170b51ee-3d66-42ce-8294-ca5ceffbdc1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:18.145516 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-170b51ee-3d66-42ce-8294-ca5ceffbdc1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:18.145966 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-170b51ee-3d66-42ce-8294-ca5ceffbdc1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:18.146389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-170b51ee-3d66-42ce-8294-ca5ceffbdc1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:18.208582 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-170b51ee-3d66-42ce-8294-ca5ceffbdc1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:18.216429 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-170b51ee-3d66-42ce-8294-ca5ceffbdc1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.082978 Aug 30 02:03:18.216994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 465/960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:18 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:18.643154 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1e9764fb-502a-4a6b-88dd-9eb243344fd5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:18.643750 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1e9764fb-502a-4a6b-88dd-9eb243344fd5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:18.650160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1e9764fb-502a-4a6b-88dd-9eb243344fd5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:18.650643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1e9764fb-502a-4a6b-88dd-9eb243344fd5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:18.651075 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1e9764fb-502a-4a6b-88dd-9eb243344fd5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:18.651768 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1e9764fb-502a-4a6b-88dd-9eb243344fd5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:18.652216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1e9764fb-502a-4a6b-88dd-9eb243344fd5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:18.652720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1e9764fb-502a-4a6b-88dd-9eb243344fd5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:18.785652 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1e9764fb-502a-4a6b-88dd-9eb243344fd5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:18.794156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1e9764fb-502a-4a6b-88dd-9eb243344fd5 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.155009 Aug 30 02:03:18.794706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 496/961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:18 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:18.896572 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d49387cb-c371-4132-a170-e95a0aacfedd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:18.897131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d49387cb-c371-4132-a170-e95a0aacfedd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:18.904401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d49387cb-c371-4132-a170-e95a0aacfedd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:18.905065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d49387cb-c371-4132-a170-e95a0aacfedd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:18.905550 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d49387cb-c371-4132-a170-e95a0aacfedd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:18.906411 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d49387cb-c371-4132-a170-e95a0aacfedd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:18.906974 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d49387cb-c371-4132-a170-e95a0aacfedd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:18.907484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d49387cb-c371-4132-a170-e95a0aacfedd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.035211 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d49387cb-c371-4132-a170-e95a0aacfedd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:19.043813 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d49387cb-c371-4132-a170-e95a0aacfedd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.151294 Aug 30 02:03:19.044395 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 466/962] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:18 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:19.238144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a4ea20f8-f802-4ba9-9ca3-e7fe68e360d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:19.238756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a4ea20f8-f802-4ba9-9ca3-e7fe68e360d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:19.244712 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4ea20f8-f802-4ba9-9ca3-e7fe68e360d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:19.245190 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4ea20f8-f802-4ba9-9ca3-e7fe68e360d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:19.245625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4ea20f8-f802-4ba9-9ca3-e7fe68e360d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.246306 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4ea20f8-f802-4ba9-9ca3-e7fe68e360d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:19.246787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4ea20f8-f802-4ba9-9ca3-e7fe68e360d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:19.247211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4ea20f8-f802-4ba9-9ca3-e7fe68e360d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.309616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a4ea20f8-f802-4ba9-9ca3-e7fe68e360d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:19.317632 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a4ea20f8-f802-4ba9-9ca3-e7fe68e360d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.083382 Aug 30 02:03:19.318290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 497/963] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:19 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:19.726463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-270ffb34-a9b6-4448-8900-dea97c95b101 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:19.726964 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-270ffb34-a9b6-4448-8900-dea97c95b101 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:19.733016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-270ffb34-a9b6-4448-8900-dea97c95b101 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:19.733506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-270ffb34-a9b6-4448-8900-dea97c95b101 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:19.733946 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-270ffb34-a9b6-4448-8900-dea97c95b101 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.734731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-270ffb34-a9b6-4448-8900-dea97c95b101 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:19.735190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-270ffb34-a9b6-4448-8900-dea97c95b101 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:19.735619 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-270ffb34-a9b6-4448-8900-dea97c95b101 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.736087 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:19.766622 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-270ffb34-a9b6-4448-8900-dea97c95b101 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments/c4d57fb9-994e-4479-92c3-f0989463fe42" status: 200 len: 194 microversion: 2.20 time: 0.044114 Aug 30 02:03:19.767210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 467/964] 10.222.0.50 () {60 vars in 1454 bytes} [Tue Aug 30 02:03:19 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments/c4d57fb9-994e-4479-92c3-f0989463fe42 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:03:19.816431 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7188a02c-f851-4ce4-a85c-de66ed2389ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:19.818072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7188a02c-f851-4ce4-a85c-de66ed2389ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:19.824564 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:19.825230 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=6 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:19.827249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7188a02c-f851-4ce4-a85c-de66ed2389ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:19.827800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7188a02c-f851-4ce4-a85c-de66ed2389ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:19.828236 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7188a02c-f851-4ce4-a85c-de66ed2389ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.828960 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7188a02c-f851-4ce4-a85c-de66ed2389ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:19.829413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7188a02c-f851-4ce4-a85c-de66ed2389ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:19.829838 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7188a02c-f851-4ce4-a85c-de66ed2389ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.837048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-97cb6fd9-6c7d-4fa9-9d5c-dafb5a2a013b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:19.837548 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-97cb6fd9-6c7d-4fa9-9d5c-dafb5a2a013b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:19.843341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97cb6fd9-6c7d-4fa9-9d5c-dafb5a2a013b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:19.843827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97cb6fd9-6c7d-4fa9-9d5c-dafb5a2a013b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:19.844285 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97cb6fd9-6c7d-4fa9-9d5c-dafb5a2a013b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.844982 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97cb6fd9-6c7d-4fa9-9d5c-dafb5a2a013b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:19.845439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97cb6fd9-6c7d-4fa9-9d5c-dafb5a2a013b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:19.845872 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97cb6fd9-6c7d-4fa9-9d5c-dafb5a2a013b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.938727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-97cb6fd9-6c7d-4fa9-9d5c-dafb5a2a013b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lazy-loading 'services' on Instance uuid 51036535-5cf5-4283-b501-b0809e3f57a6 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:03:19.973167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7188a02c-f851-4ce4-a85c-de66ed2389ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:19.982203 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7188a02c-f851-4ce4-a85c-de66ed2389ee tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.169932 Aug 30 02:03:19.982771 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 498/965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:19 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:20.013644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-97cb6fd9-6c7d-4fa9-9d5c-dafb5a2a013b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "DELETE /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments/c4d57fb9-994e-4479-92c3-f0989463fe42" status: 202 len: 0 microversion: 2.20 time: 0.180382 Aug 30 02:03:20.014217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 468/966] 10.222.0.50 () {60 vars in 1457 bytes} [Tue Aug 30 02:03:19 2022] DELETE /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments/c4d57fb9-994e-4479-92c3-f0989463fe42 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 02:03:20.023318 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fb2013f5-6903-40a8-9382-81154ba87787 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:20.025583 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-fb2013f5-6903-40a8-9382-81154ba87787 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:20.031702 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb2013f5-6903-40a8-9382-81154ba87787 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:20.032206 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb2013f5-6903-40a8-9382-81154ba87787 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:20.032676 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb2013f5-6903-40a8-9382-81154ba87787 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:20.033564 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb2013f5-6903-40a8-9382-81154ba87787 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:20.034024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb2013f5-6903-40a8-9382-81154ba87787 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:20.034458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fb2013f5-6903-40a8-9382-81154ba87787 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:20.064288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3efceddf-3824-491c-931a-4cd8a0edbf7d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:20.065027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3efceddf-3824-491c-931a-4cd8a0edbf7d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:20.067528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-fb2013f5-6903-40a8-9382-81154ba87787 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048605 Aug 30 02:03:20.068184 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 499/967] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:20 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:03:20.075539 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3efceddf-3824-491c-931a-4cd8a0edbf7d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:20.076016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3efceddf-3824-491c-931a-4cd8a0edbf7d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:20.076673 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3efceddf-3824-491c-931a-4cd8a0edbf7d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:20.077380 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3efceddf-3824-491c-931a-4cd8a0edbf7d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:20.077838 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3efceddf-3824-491c-931a-4cd8a0edbf7d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:20.078265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3efceddf-3824-491c-931a-4cd8a0edbf7d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:20.216268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3efceddf-3824-491c-931a-4cd8a0edbf7d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:20.224094 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3efceddf-3824-491c-931a-4cd8a0edbf7d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.163908 Aug 30 02:03:20.224881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 469/968] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:20 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:20.339748 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c859bd81-2eca-434b-bc0e-51b2b335d254 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:20.340396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c859bd81-2eca-434b-bc0e-51b2b335d254 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:20.346261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c859bd81-2eca-434b-bc0e-51b2b335d254 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:20.346772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c859bd81-2eca-434b-bc0e-51b2b335d254 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:20.347208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c859bd81-2eca-434b-bc0e-51b2b335d254 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:20.347904 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c859bd81-2eca-434b-bc0e-51b2b335d254 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:20.348374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c859bd81-2eca-434b-bc0e-51b2b335d254 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:20.348799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c859bd81-2eca-434b-bc0e-51b2b335d254 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:20.410397 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c859bd81-2eca-434b-bc0e-51b2b335d254 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:20.418195 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c859bd81-2eca-434b-bc0e-51b2b335d254 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.082834 Aug 30 02:03:20.418954 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 500/969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:20 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:21.004677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-98deaf5d-7a58-42a9-85db-b7ddc57af17a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:21.006235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-98deaf5d-7a58-42a9-85db-b7ddc57af17a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:21.016113 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98deaf5d-7a58-42a9-85db-b7ddc57af17a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:21.016720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98deaf5d-7a58-42a9-85db-b7ddc57af17a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:21.017264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98deaf5d-7a58-42a9-85db-b7ddc57af17a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:21.018043 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98deaf5d-7a58-42a9-85db-b7ddc57af17a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:21.018570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98deaf5d-7a58-42a9-85db-b7ddc57af17a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:21.019068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-98deaf5d-7a58-42a9-85db-b7ddc57af17a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:21.080355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-65bc811e-1d91-4bd2-af38-8b1d2b7d01ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:21.082618 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-65bc811e-1d91-4bd2-af38-8b1d2b7d01ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:21.089870 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65bc811e-1d91-4bd2-af38-8b1d2b7d01ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:21.090611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65bc811e-1d91-4bd2-af38-8b1d2b7d01ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:21.091049 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65bc811e-1d91-4bd2-af38-8b1d2b7d01ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:21.091752 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65bc811e-1d91-4bd2-af38-8b1d2b7d01ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:21.092530 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65bc811e-1d91-4bd2-af38-8b1d2b7d01ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:21.092964 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65bc811e-1d91-4bd2-af38-8b1d2b7d01ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:21.124744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-65bc811e-1d91-4bd2-af38-8b1d2b7d01ec tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048303 Aug 30 02:03:21.129961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 501/970] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:21 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 02:03:21.158358 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-98deaf5d-7a58-42a9-85db-b7ddc57af17a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:21.166773 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-98deaf5d-7a58-42a9-85db-b7ddc57af17a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.165963 Aug 30 02:03:21.167339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 470/971] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:20 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:21.245006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bd541b6c-8a85-4f2e-bc95-930b804e4cf4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:21.245617 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bd541b6c-8a85-4f2e-bc95-930b804e4cf4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:21.251711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bd541b6c-8a85-4f2e-bc95-930b804e4cf4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:21.252197 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bd541b6c-8a85-4f2e-bc95-930b804e4cf4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:21.252702 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bd541b6c-8a85-4f2e-bc95-930b804e4cf4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:21.253406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bd541b6c-8a85-4f2e-bc95-930b804e4cf4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:21.253855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bd541b6c-8a85-4f2e-bc95-930b804e4cf4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:21.254279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bd541b6c-8a85-4f2e-bc95-930b804e4cf4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:21.386078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-bd541b6c-8a85-4f2e-bc95-930b804e4cf4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:21.394632 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bd541b6c-8a85-4f2e-bc95-930b804e4cf4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.153928 Aug 30 02:03:21.395129 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 502/972] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:21 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:21.439076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a2812d77-726f-46b1-a9b2-a6c41f2590a4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:21.439721 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a2812d77-726f-46b1-a9b2-a6c41f2590a4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:21.446101 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2812d77-726f-46b1-a9b2-a6c41f2590a4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:21.446579 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2812d77-726f-46b1-a9b2-a6c41f2590a4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:21.447006 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2812d77-726f-46b1-a9b2-a6c41f2590a4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:21.447694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2812d77-726f-46b1-a9b2-a6c41f2590a4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:21.448140 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2812d77-726f-46b1-a9b2-a6c41f2590a4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:21.448586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a2812d77-726f-46b1-a9b2-a6c41f2590a4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:21.514633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a2812d77-726f-46b1-a9b2-a6c41f2590a4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:21.522494 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a2812d77-726f-46b1-a9b2-a6c41f2590a4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.087353 Aug 30 02:03:21.523628 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 471/973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:21 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:22.138435 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4c1aba26-6f66-47b3-affd-1b4961f0562b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:22.140596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4c1aba26-6f66-47b3-affd-1b4961f0562b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:22.147366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c1aba26-6f66-47b3-affd-1b4961f0562b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:22.148125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c1aba26-6f66-47b3-affd-1b4961f0562b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:22.148586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c1aba26-6f66-47b3-affd-1b4961f0562b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:22.149284 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c1aba26-6f66-47b3-affd-1b4961f0562b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:22.149734 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c1aba26-6f66-47b3-affd-1b4961f0562b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:22.150214 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c1aba26-6f66-47b3-affd-1b4961f0562b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:22.176338 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:22.182873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4c1aba26-6f66-47b3-affd-1b4961f0562b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048598 Aug 30 02:03:22.183749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 503/974] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:22 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:03:22.188864 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b4015f69-d0e8-4718-8e60-b86131694141 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:22.189503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b4015f69-d0e8-4718-8e60-b86131694141 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:22.196917 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4015f69-d0e8-4718-8e60-b86131694141 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:22.197409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4015f69-d0e8-4718-8e60-b86131694141 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:22.197846 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4015f69-d0e8-4718-8e60-b86131694141 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:22.198752 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4015f69-d0e8-4718-8e60-b86131694141 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:22.199209 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4015f69-d0e8-4718-8e60-b86131694141 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:22.199633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b4015f69-d0e8-4718-8e60-b86131694141 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:22.331581 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b4015f69-d0e8-4718-8e60-b86131694141 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:22.340631 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b4015f69-d0e8-4718-8e60-b86131694141 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.155827 Aug 30 02:03:22.341219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 472/975] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:22 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:22.416746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b7e3e6af-0d4f-4389-8c6c-932a9c9bbaf8 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:22.417281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b7e3e6af-0d4f-4389-8c6c-932a9c9bbaf8 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:22.423559 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b7e3e6af-0d4f-4389-8c6c-932a9c9bbaf8 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:22.424041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b7e3e6af-0d4f-4389-8c6c-932a9c9bbaf8 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:22.424501 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b7e3e6af-0d4f-4389-8c6c-932a9c9bbaf8 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:22.425201 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b7e3e6af-0d4f-4389-8c6c-932a9c9bbaf8 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:22.425646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b7e3e6af-0d4f-4389-8c6c-932a9c9bbaf8 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:22.426085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b7e3e6af-0d4f-4389-8c6c-932a9c9bbaf8 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:22.546928 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-621f0b78-66ea-4ec1-a69f-5a84a60a7af9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:22.548128 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-621f0b78-66ea-4ec1-a69f-5a84a60a7af9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:22.553556 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-621f0b78-66ea-4ec1-a69f-5a84a60a7af9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:22.554110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-621f0b78-66ea-4ec1-a69f-5a84a60a7af9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:22.555057 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-621f0b78-66ea-4ec1-a69f-5a84a60a7af9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:22.556424 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-621f0b78-66ea-4ec1-a69f-5a84a60a7af9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:22.556424 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-621f0b78-66ea-4ec1-a69f-5a84a60a7af9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:22.556760 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-621f0b78-66ea-4ec1-a69f-5a84a60a7af9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:22.623170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b7e3e6af-0d4f-4389-8c6c-932a9c9bbaf8 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:22.627096 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-621f0b78-66ea-4ec1-a69f-5a84a60a7af9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:22.630575 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b7e3e6af-0d4f-4389-8c6c-932a9c9bbaf8 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.218807 Aug 30 02:03:22.631286 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 504/976] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:22 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:22.637413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-621f0b78-66ea-4ec1-a69f-5a84a60a7af9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.094967 Aug 30 02:03:22.638418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 473/977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:22 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:23.195139 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c1bf521f-a385-4ef8-b467-66d4ec83395e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:23.197870 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c1bf521f-a385-4ef8-b467-66d4ec83395e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:23.204320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1bf521f-a385-4ef8-b467-66d4ec83395e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:23.204807 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1bf521f-a385-4ef8-b467-66d4ec83395e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:23.205249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1bf521f-a385-4ef8-b467-66d4ec83395e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:23.205949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1bf521f-a385-4ef8-b467-66d4ec83395e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:23.206401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1bf521f-a385-4ef8-b467-66d4ec83395e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:23.206823 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1bf521f-a385-4ef8-b467-66d4ec83395e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:23.238886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c1bf521f-a385-4ef8-b467-66d4ec83395e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047676 Aug 30 02:03:23.239650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 505/978] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:23 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:03:23.362116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-237c8894-bd52-4f08-a423-07f8b14bedd9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:23.362817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-237c8894-bd52-4f08-a423-07f8b14bedd9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:23.370038 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-237c8894-bd52-4f08-a423-07f8b14bedd9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:23.370609 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-237c8894-bd52-4f08-a423-07f8b14bedd9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:23.371113 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-237c8894-bd52-4f08-a423-07f8b14bedd9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:23.371894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-237c8894-bd52-4f08-a423-07f8b14bedd9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:23.372451 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-237c8894-bd52-4f08-a423-07f8b14bedd9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:23.372936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-237c8894-bd52-4f08-a423-07f8b14bedd9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:23.504097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-237c8894-bd52-4f08-a423-07f8b14bedd9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:23.513264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-237c8894-bd52-4f08-a423-07f8b14bedd9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.154961 Aug 30 02:03:23.513821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 474/979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:23 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:23.650753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-15a24140-dea6-4105-a377-16defd7bf6fa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:23.651371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-15a24140-dea6-4105-a377-16defd7bf6fa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:23.657682 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15a24140-dea6-4105-a377-16defd7bf6fa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:23.658161 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15a24140-dea6-4105-a377-16defd7bf6fa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:23.658595 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15a24140-dea6-4105-a377-16defd7bf6fa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:23.659289 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15a24140-dea6-4105-a377-16defd7bf6fa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:23.659747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15a24140-dea6-4105-a377-16defd7bf6fa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:23.660167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15a24140-dea6-4105-a377-16defd7bf6fa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:23.661043 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6f0d262b-2380-43c9-9370-ca6bf5e77ce5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:23.661659 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6f0d262b-2380-43c9-9370-ca6bf5e77ce5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:23.667605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f0d262b-2380-43c9-9370-ca6bf5e77ce5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:23.668093 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f0d262b-2380-43c9-9370-ca6bf5e77ce5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:23.668561 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f0d262b-2380-43c9-9370-ca6bf5e77ce5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:23.669256 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f0d262b-2380-43c9-9370-ca6bf5e77ce5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:23.669712 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f0d262b-2380-43c9-9370-ca6bf5e77ce5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:23.670138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6f0d262b-2380-43c9-9370-ca6bf5e77ce5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:23.734452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6f0d262b-2380-43c9-9370-ca6bf5e77ce5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:23.744511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6f0d262b-2380-43c9-9370-ca6bf5e77ce5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.087241 Aug 30 02:03:23.745276 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 475/980] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:23 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:23.795017 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-15a24140-dea6-4105-a377-16defd7bf6fa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:23.802879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-15a24140-dea6-4105-a377-16defd7bf6fa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.156144 Aug 30 02:03:23.803729 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 506/981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:23 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:24.252732 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9f34d376-44e9-4192-b793-e3541a491ad3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:24.256095 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9f34d376-44e9-4192-b793-e3541a491ad3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:24.268110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f34d376-44e9-4192-b793-e3541a491ad3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:24.268723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f34d376-44e9-4192-b793-e3541a491ad3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:24.269155 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f34d376-44e9-4192-b793-e3541a491ad3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:24.269856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f34d376-44e9-4192-b793-e3541a491ad3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:24.270305 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f34d376-44e9-4192-b793-e3541a491ad3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:24.270724 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9f34d376-44e9-4192-b793-e3541a491ad3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:24.301151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9f34d376-44e9-4192-b793-e3541a491ad3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052913 Aug 30 02:03:24.301712 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 476/982] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:24 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:03:24.534614 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d3ce1e66-93be-4ce6-9b0d-e87392c81859 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:24.535210 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d3ce1e66-93be-4ce6-9b0d-e87392c81859 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:24.542100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3ce1e66-93be-4ce6-9b0d-e87392c81859 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:24.542681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3ce1e66-93be-4ce6-9b0d-e87392c81859 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:24.543110 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3ce1e66-93be-4ce6-9b0d-e87392c81859 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:24.543920 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3ce1e66-93be-4ce6-9b0d-e87392c81859 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:24.544408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3ce1e66-93be-4ce6-9b0d-e87392c81859 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:24.544836 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3ce1e66-93be-4ce6-9b0d-e87392c81859 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:24.681664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d3ce1e66-93be-4ce6-9b0d-e87392c81859 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:24.690032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d3ce1e66-93be-4ce6-9b0d-e87392c81859 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.159404 Aug 30 02:03:24.690597 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 507/983] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:24 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:24.765448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0d363fee-395c-40b5-a232-845fd8b2aaff tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:24.766072 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0d363fee-395c-40b5-a232-845fd8b2aaff tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:24.772660 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d363fee-395c-40b5-a232-845fd8b2aaff tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:24.773148 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d363fee-395c-40b5-a232-845fd8b2aaff tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:24.773583 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d363fee-395c-40b5-a232-845fd8b2aaff tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:24.774292 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d363fee-395c-40b5-a232-845fd8b2aaff tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:24.774744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d363fee-395c-40b5-a232-845fd8b2aaff tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:24.775168 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0d363fee-395c-40b5-a232-845fd8b2aaff tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:24.832781 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a5761ada-d197-4ab8-afbf-52689e4e5f56 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:24.833732 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a5761ada-d197-4ab8-afbf-52689e4e5f56 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:24.841677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5761ada-d197-4ab8-afbf-52689e4e5f56 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:24.841864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5761ada-d197-4ab8-afbf-52689e4e5f56 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:24.842309 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5761ada-d197-4ab8-afbf-52689e4e5f56 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:24.843024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5761ada-d197-4ab8-afbf-52689e4e5f56 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:24.843475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5761ada-d197-4ab8-afbf-52689e4e5f56 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:24.843902 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a5761ada-d197-4ab8-afbf-52689e4e5f56 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:24.844014 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0d363fee-395c-40b5-a232-845fd8b2aaff tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:24.862603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0d363fee-395c-40b5-a232-845fd8b2aaff tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.100939 Aug 30 02:03:24.869460 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 477/984] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:24 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:24.998412 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a5761ada-d197-4ab8-afbf-52689e4e5f56 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:25.006211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a5761ada-d197-4ab8-afbf-52689e4e5f56 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.186544 Aug 30 02:03:25.006779 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 508/985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:24 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:25.313457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1b87288d-c4e8-45b2-b4a6-cf11dbda66cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:25.315707 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1b87288d-c4e8-45b2-b4a6-cf11dbda66cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:25.321667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1b87288d-c4e8-45b2-b4a6-cf11dbda66cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:25.322147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1b87288d-c4e8-45b2-b4a6-cf11dbda66cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:25.322574 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1b87288d-c4e8-45b2-b4a6-cf11dbda66cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:25.323266 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1b87288d-c4e8-45b2-b4a6-cf11dbda66cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:25.323713 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1b87288d-c4e8-45b2-b4a6-cf11dbda66cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:25.324123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1b87288d-c4e8-45b2-b4a6-cf11dbda66cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:25.353754 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1b87288d-c4e8-45b2-b4a6-cf11dbda66cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044350 Aug 30 02:03:25.354307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 478/986] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:25 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:03:25.711416 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-32475aeb-ce1c-4cf6-b423-2c8c12880d5f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:25.712636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-32475aeb-ce1c-4cf6-b423-2c8c12880d5f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:25.719164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32475aeb-ce1c-4cf6-b423-2c8c12880d5f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:25.719656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32475aeb-ce1c-4cf6-b423-2c8c12880d5f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:25.720166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32475aeb-ce1c-4cf6-b423-2c8c12880d5f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:25.721069 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32475aeb-ce1c-4cf6-b423-2c8c12880d5f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:25.721556 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32475aeb-ce1c-4cf6-b423-2c8c12880d5f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:25.721986 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-32475aeb-ce1c-4cf6-b423-2c8c12880d5f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:25.865820 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-32475aeb-ce1c-4cf6-b423-2c8c12880d5f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:25.874044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-32475aeb-ce1c-4cf6-b423-2c8c12880d5f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.166548 Aug 30 02:03:25.874918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 509/987] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:25 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:25.885217 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-14bfbaee-f04d-4c81-bed8-d5f5045f863a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:25.886147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-14bfbaee-f04d-4c81-bed8-d5f5045f863a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:25.893062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14bfbaee-f04d-4c81-bed8-d5f5045f863a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:25.893597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14bfbaee-f04d-4c81-bed8-d5f5045f863a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:25.894031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14bfbaee-f04d-4c81-bed8-d5f5045f863a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:25.894727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14bfbaee-f04d-4c81-bed8-d5f5045f863a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:25.895234 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14bfbaee-f04d-4c81-bed8-d5f5045f863a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:25.896074 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-14bfbaee-f04d-4c81-bed8-d5f5045f863a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:25.962724 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-14bfbaee-f04d-4c81-bed8-d5f5045f863a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:25.971105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-14bfbaee-f04d-4c81-bed8-d5f5045f863a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.089942 Aug 30 02:03:25.971664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 479/988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:25 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:26.027525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5ce5b849-8500-40cb-a00a-3c33b5db9140 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:26.028125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5ce5b849-8500-40cb-a00a-3c33b5db9140 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:26.034876 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce5b849-8500-40cb-a00a-3c33b5db9140 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:26.035355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce5b849-8500-40cb-a00a-3c33b5db9140 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:26.035785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce5b849-8500-40cb-a00a-3c33b5db9140 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:26.036505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce5b849-8500-40cb-a00a-3c33b5db9140 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:26.036985 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce5b849-8500-40cb-a00a-3c33b5db9140 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:26.037405 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ce5b849-8500-40cb-a00a-3c33b5db9140 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:26.172931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ce5b849-8500-40cb-a00a-3c33b5db9140 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:26.181315 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5ce5b849-8500-40cb-a00a-3c33b5db9140 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.158166 Aug 30 02:03:26.181919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 510/989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:26 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:26.366359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a338c4d4-9bcf-4418-8bac-f33852017b5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:26.369133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a338c4d4-9bcf-4418-8bac-f33852017b5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:26.375164 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a338c4d4-9bcf-4418-8bac-f33852017b5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:26.375650 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a338c4d4-9bcf-4418-8bac-f33852017b5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:26.376086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a338c4d4-9bcf-4418-8bac-f33852017b5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:26.376816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a338c4d4-9bcf-4418-8bac-f33852017b5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:26.377268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a338c4d4-9bcf-4418-8bac-f33852017b5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:26.377692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a338c4d4-9bcf-4418-8bac-f33852017b5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:26.381662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:26.410017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a338c4d4-9bcf-4418-8bac-f33852017b5c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047746 Aug 30 02:03:26.410568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 480/990] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:26 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:03:26.902602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c67d38f6-58c3-405c-868e-fd720c42d6c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:26.903217 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c67d38f6-58c3-405c-868e-fd720c42d6c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:26.909814 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c67d38f6-58c3-405c-868e-fd720c42d6c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:26.910303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c67d38f6-58c3-405c-868e-fd720c42d6c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:26.910741 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c67d38f6-58c3-405c-868e-fd720c42d6c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:26.911468 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c67d38f6-58c3-405c-868e-fd720c42d6c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:26.911925 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c67d38f6-58c3-405c-868e-fd720c42d6c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:26.912375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c67d38f6-58c3-405c-868e-fd720c42d6c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:26.991916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5c5a2725-ca33-403b-a5eb-bec0fdc538ee tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:26.992606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5c5a2725-ca33-403b-a5eb-bec0fdc538ee tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:26.999755 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5a2725-ca33-403b-a5eb-bec0fdc538ee tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:27.000258 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5a2725-ca33-403b-a5eb-bec0fdc538ee tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:27.000713 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5a2725-ca33-403b-a5eb-bec0fdc538ee tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:27.001405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5a2725-ca33-403b-a5eb-bec0fdc538ee tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:27.001855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5a2725-ca33-403b-a5eb-bec0fdc538ee tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:27.002279 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c5a2725-ca33-403b-a5eb-bec0fdc538ee tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:27.048334 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c67d38f6-58c3-405c-868e-fd720c42d6c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:27.057458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c67d38f6-58c3-405c-868e-fd720c42d6c0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.158629 Aug 30 02:03:27.058044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 511/991] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:26 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:27.069658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5c5a2725-ca33-403b-a5eb-bec0fdc538ee tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:27.077539 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5c5a2725-ca33-403b-a5eb-bec0fdc538ee tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.089419 Aug 30 02:03:27.078086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 481/992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:26 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:27.201907 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d679bf44-433f-4f6d-bc20-ab7cea9f4a51 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:27.202542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d679bf44-433f-4f6d-bc20-ab7cea9f4a51 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:27.204392 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:27.209444 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d679bf44-433f-4f6d-bc20-ab7cea9f4a51 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:27.209939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d679bf44-433f-4f6d-bc20-ab7cea9f4a51 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:27.210350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d679bf44-433f-4f6d-bc20-ab7cea9f4a51 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:27.211032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d679bf44-433f-4f6d-bc20-ab7cea9f4a51 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:27.211480 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d679bf44-433f-4f6d-bc20-ab7cea9f4a51 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:27.212423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d679bf44-433f-4f6d-bc20-ab7cea9f4a51 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:27.343454 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d679bf44-433f-4f6d-bc20-ab7cea9f4a51 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:27.350980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d679bf44-433f-4f6d-bc20-ab7cea9f4a51 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.152913 Aug 30 02:03:27.351529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 512/993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:27 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:27.422000 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bb323f76-ce27-4662-9549-c998e686d0b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:27.424134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bb323f76-ce27-4662-9549-c998e686d0b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:27.429958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb323f76-ce27-4662-9549-c998e686d0b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:27.430430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb323f76-ce27-4662-9549-c998e686d0b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:27.431373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb323f76-ce27-4662-9549-c998e686d0b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:27.432047 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb323f76-ce27-4662-9549-c998e686d0b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:27.432526 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb323f76-ce27-4662-9549-c998e686d0b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:27.432939 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb323f76-ce27-4662-9549-c998e686d0b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:27.461640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bb323f76-ce27-4662-9549-c998e686d0b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043534 Aug 30 02:03:27.462102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 482/994] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:27 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:03:28.078769 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-44be1e7d-f124-4891-9f68-de8e8241511d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:28.079303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-44be1e7d-f124-4891-9f68-de8e8241511d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:28.085730 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44be1e7d-f124-4891-9f68-de8e8241511d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:28.086206 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44be1e7d-f124-4891-9f68-de8e8241511d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:28.086662 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44be1e7d-f124-4891-9f68-de8e8241511d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:28.087389 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44be1e7d-f124-4891-9f68-de8e8241511d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:28.087833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44be1e7d-f124-4891-9f68-de8e8241511d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:28.088264 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-44be1e7d-f124-4891-9f68-de8e8241511d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:28.099249 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-02030143-ac01-44a9-ae82-e1e4052defe4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:28.099865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-02030143-ac01-44a9-ae82-e1e4052defe4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:28.106812 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02030143-ac01-44a9-ae82-e1e4052defe4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:28.107296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02030143-ac01-44a9-ae82-e1e4052defe4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:28.107731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02030143-ac01-44a9-ae82-e1e4052defe4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:28.108457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02030143-ac01-44a9-ae82-e1e4052defe4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:28.108913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02030143-ac01-44a9-ae82-e1e4052defe4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:28.109339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02030143-ac01-44a9-ae82-e1e4052defe4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:28.175232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-02030143-ac01-44a9-ae82-e1e4052defe4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:28.183949 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-02030143-ac01-44a9-ae82-e1e4052defe4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.088696 Aug 30 02:03:28.184809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 483/995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:28 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:28.216570 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-44be1e7d-f124-4891-9f68-de8e8241511d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:28.224612 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-44be1e7d-f124-4891-9f68-de8e8241511d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.149763 Aug 30 02:03:28.225169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 513/996] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:28 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:28.371470 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fda0e5b6-13ec-475a-b716-7a9f349ae146 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:28.372018 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fda0e5b6-13ec-475a-b716-7a9f349ae146 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:28.377947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda0e5b6-13ec-475a-b716-7a9f349ae146 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:28.378418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda0e5b6-13ec-475a-b716-7a9f349ae146 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:28.378844 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda0e5b6-13ec-475a-b716-7a9f349ae146 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:28.379516 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda0e5b6-13ec-475a-b716-7a9f349ae146 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:28.379960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda0e5b6-13ec-475a-b716-7a9f349ae146 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:28.380404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fda0e5b6-13ec-475a-b716-7a9f349ae146 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:28.473773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-03b0d800-cf15-4f29-bfc9-13ce6c023107 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:28.476003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-03b0d800-cf15-4f29-bfc9-13ce6c023107 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:28.482530 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03b0d800-cf15-4f29-bfc9-13ce6c023107 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:28.483012 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03b0d800-cf15-4f29-bfc9-13ce6c023107 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:28.483444 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03b0d800-cf15-4f29-bfc9-13ce6c023107 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:28.484136 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03b0d800-cf15-4f29-bfc9-13ce6c023107 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:28.484622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03b0d800-cf15-4f29-bfc9-13ce6c023107 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:28.485043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-03b0d800-cf15-4f29-bfc9-13ce6c023107 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:28.514644 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-03b0d800-cf15-4f29-bfc9-13ce6c023107 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044785 Aug 30 02:03:28.515250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 514/997] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:28 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 02:03:28.519058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fda0e5b6-13ec-475a-b716-7a9f349ae146 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:28.526633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fda0e5b6-13ec-475a-b716-7a9f349ae146 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.159694 Aug 30 02:03:28.527177 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 484/998] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:28 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:29.206058 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e1cdd3f3-4caf-4805-9c90-6281701e7d4d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:29.206668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e1cdd3f3-4caf-4805-9c90-6281701e7d4d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:29.213758 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1cdd3f3-4caf-4805-9c90-6281701e7d4d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:29.214269 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1cdd3f3-4caf-4805-9c90-6281701e7d4d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:29.214702 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1cdd3f3-4caf-4805-9c90-6281701e7d4d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:29.215386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1cdd3f3-4caf-4805-9c90-6281701e7d4d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:29.215834 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1cdd3f3-4caf-4805-9c90-6281701e7d4d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:29.216261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e1cdd3f3-4caf-4805-9c90-6281701e7d4d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:29.246177 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9509c58f-6a16-4620-a3fc-99fc86de5891 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:29.246795 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9509c58f-6a16-4620-a3fc-99fc86de5891 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:29.253214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9509c58f-6a16-4620-a3fc-99fc86de5891 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:29.253699 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9509c58f-6a16-4620-a3fc-99fc86de5891 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:29.254134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9509c58f-6a16-4620-a3fc-99fc86de5891 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:29.254828 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9509c58f-6a16-4620-a3fc-99fc86de5891 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:29.255287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9509c58f-6a16-4620-a3fc-99fc86de5891 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:29.255709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9509c58f-6a16-4620-a3fc-99fc86de5891 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:29.279708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e1cdd3f3-4caf-4805-9c90-6281701e7d4d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:29.287990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e1cdd3f3-4caf-4805-9c90-6281701e7d4d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1613 microversion: 2.1 time: 0.085718 Aug 30 02:03:29.289022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 515/999] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:29 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1613 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:29.387819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9509c58f-6a16-4620-a3fc-99fc86de5891 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:29.395891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9509c58f-6a16-4620-a3fc-99fc86de5891 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1722 microversion: 2.1 time: 0.153623 Aug 30 02:03:29.396491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 485/1000] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:29 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:29.527700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ed520773-86aa-4dce-b48f-b2fd8c9cca42 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:29.529973 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ed520773-86aa-4dce-b48f-b2fd8c9cca42 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:29.535929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed520773-86aa-4dce-b48f-b2fd8c9cca42 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:29.536452 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed520773-86aa-4dce-b48f-b2fd8c9cca42 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:29.536890 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed520773-86aa-4dce-b48f-b2fd8c9cca42 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:29.537579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed520773-86aa-4dce-b48f-b2fd8c9cca42 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:29.538030 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed520773-86aa-4dce-b48f-b2fd8c9cca42 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:29.538452 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ed520773-86aa-4dce-b48f-b2fd8c9cca42 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:29.547305 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-93bcc42e-5fec-4e03-a157-b6c129862b25 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:29.547942 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-93bcc42e-5fec-4e03-a157-b6c129862b25 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:29.554031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93bcc42e-5fec-4e03-a157-b6c129862b25 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:29.554517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93bcc42e-5fec-4e03-a157-b6c129862b25 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:29.554953 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93bcc42e-5fec-4e03-a157-b6c129862b25 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:29.555651 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93bcc42e-5fec-4e03-a157-b6c129862b25 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:29.556104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93bcc42e-5fec-4e03-a157-b6c129862b25 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:29.556563 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93bcc42e-5fec-4e03-a157-b6c129862b25 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:29.568252 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ed520773-86aa-4dce-b48f-b2fd8c9cca42 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045122 Aug 30 02:03:29.568812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 516/1001] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:29 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:03:29.680232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-93bcc42e-5fec-4e03-a157-b6c129862b25 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:29.687980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-93bcc42e-5fec-4e03-a157-b6c129862b25 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.144576 Aug 30 02:03:29.688571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 486/1002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:29 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:30.309777 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-de8abfdf-4f93-4caf-b989-cdf2a590dc4f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:30.310567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-de8abfdf-4f93-4caf-b989-cdf2a590dc4f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:30.319548 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de8abfdf-4f93-4caf-b989-cdf2a590dc4f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.320123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de8abfdf-4f93-4caf-b989-cdf2a590dc4f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.320642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de8abfdf-4f93-4caf-b989-cdf2a590dc4f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.321952 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de8abfdf-4f93-4caf-b989-cdf2a590dc4f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.322433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de8abfdf-4f93-4caf-b989-cdf2a590dc4f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.322857 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de8abfdf-4f93-4caf-b989-cdf2a590dc4f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.418017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cb09e58-8b77-464b-80e6-feec331eee55 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:30.418727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7cb09e58-8b77-464b-80e6-feec331eee55 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:30.420569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-de8abfdf-4f93-4caf-b989-cdf2a590dc4f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:30.425835 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb09e58-8b77-464b-80e6-feec331eee55 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.426406 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb09e58-8b77-464b-80e6-feec331eee55 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.426937 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb09e58-8b77-464b-80e6-feec331eee55 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.427803 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb09e58-8b77-464b-80e6-feec331eee55 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.428470 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb09e58-8b77-464b-80e6-feec331eee55 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.428931 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cb09e58-8b77-464b-80e6-feec331eee55 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.429928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-de8abfdf-4f93-4caf-b989-cdf2a590dc4f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1327 microversion: 2.1 time: 0.124556 Aug 30 02:03:30.437128 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 517/1003] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:30 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:30.562034 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7cb09e58-8b77-464b-80e6-feec331eee55 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:30.570317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7cb09e58-8b77-464b-80e6-feec331eee55 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.156997 Aug 30 02:03:30.571108 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 487/1004] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:30 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:30.589001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6a68276d-a298-4201-87ee-0921cd41cf3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:30.591312 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6a68276d-a298-4201-87ee-0921cd41cf3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:30.597295 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a68276d-a298-4201-87ee-0921cd41cf3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.597863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a68276d-a298-4201-87ee-0921cd41cf3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.598380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a68276d-a298-4201-87ee-0921cd41cf3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.599162 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a68276d-a298-4201-87ee-0921cd41cf3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.599696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a68276d-a298-4201-87ee-0921cd41cf3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.600201 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6a68276d-a298-4201-87ee-0921cd41cf3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.630600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6a68276d-a298-4201-87ee-0921cd41cf3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045655 Aug 30 02:03:30.631392 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 518/1005] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:30 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:03:30.709125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e4707ff6-d262-474b-9d4f-f6f3f5773536 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:30.710324 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e4707ff6-d262-474b-9d4f-f6f3f5773536 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:30.716459 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4707ff6-d262-474b-9d4f-f6f3f5773536 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.717071 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4707ff6-d262-474b-9d4f-f6f3f5773536 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.717504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4707ff6-d262-474b-9d4f-f6f3f5773536 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.718192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4707ff6-d262-474b-9d4f-f6f3f5773536 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.718652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4707ff6-d262-474b-9d4f-f6f3f5773536 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.719066 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4707ff6-d262-474b-9d4f-f6f3f5773536 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.872184 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e4707ff6-d262-474b-9d4f-f6f3f5773536 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:30.880666 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e4707ff6-d262-474b-9d4f-f6f3f5773536 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.175380 Aug 30 02:03:30.881238 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 488/1006] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:30 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:30.977338 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-b4fa44e7-1a6b-4520-bf09-068b64a713c8 req-ce29f9e3-6e69-4a08-94d2-880d3a078ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ed5413-5513-4b3f-8588-34ba725fff26", "tag": "368b4b69-ee2c-423b-823b-2d0eae43ecae"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:30.987008 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b4fa44e7-1a6b-4520-bf09-068b64a713c8 req-ce29f9e3-6e69-4a08-94d2-880d3a078ea0 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.987479 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b4fa44e7-1a6b-4520-bf09-068b64a713c8 req-ce29f9e3-6e69-4a08-94d2-880d3a078ea0 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.987902 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b4fa44e7-1a6b-4520-bf09-068b64a713c8 req-ce29f9e3-6e69-4a08-94d2-880d3a078ea0 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.998629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-b4fa44e7-1a6b-4520-bf09-068b64a713c8 req-ce29f9e3-6e69-4a08-94d2-880d3a078ea0 service nova] Creating event network-changed:368b4b69-ee2c-423b-823b-2d0eae43ecae for instance b0ed5413-5513-4b3f-8588-34ba725fff26 on hv-cinder-81966 Aug 30 02:03:31.003458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-b4fa44e7-1a6b-4520-bf09-068b64a713c8 req-ce29f9e3-6e69-4a08-94d2-880d3a078ea0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029812 Aug 30 02:03:31.004043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 519/1007] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:03:31.451019 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:31.451633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:31.458134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.458618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.459162 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:31.459896 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.460380 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.460886 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:31.493206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.493688 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.494118 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:31.494559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lazy-loading 'fault' on Instance uuid 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:03:31.535342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:31.542851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a7989fc7-c2fc-4f6b-82a0-65f65253f063 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1332 microversion: 2.1 time: 0.095688 Aug 30 02:03:31.543403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 489/1008] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:31 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:31.594547 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-eec36a8d-b9e8-4ca1-9d23-bff9a65edf60 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:31.595176 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-eec36a8d-b9e8-4ca1-9d23-bff9a65edf60 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:31.601281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eec36a8d-b9e8-4ca1-9d23-bff9a65edf60 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.601799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eec36a8d-b9e8-4ca1-9d23-bff9a65edf60 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.602237 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eec36a8d-b9e8-4ca1-9d23-bff9a65edf60 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:31.602929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eec36a8d-b9e8-4ca1-9d23-bff9a65edf60 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.603384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eec36a8d-b9e8-4ca1-9d23-bff9a65edf60 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.603809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eec36a8d-b9e8-4ca1-9d23-bff9a65edf60 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:31.643031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ead2b049-7b2b-479f-be46-1cce882860dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:31.645297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ead2b049-7b2b-479f-be46-1cce882860dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:31.651417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ead2b049-7b2b-479f-be46-1cce882860dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.651895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ead2b049-7b2b-479f-be46-1cce882860dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.652350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ead2b049-7b2b-479f-be46-1cce882860dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:31.653040 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ead2b049-7b2b-479f-be46-1cce882860dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.653485 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ead2b049-7b2b-479f-be46-1cce882860dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.653925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ead2b049-7b2b-479f-be46-1cce882860dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:31.685946 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ead2b049-7b2b-479f-be46-1cce882860dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046780 Aug 30 02:03:31.686499 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 490/1009] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:31 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 02:03:31.736054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-eec36a8d-b9e8-4ca1-9d23-bff9a65edf60 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:31.743720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-eec36a8d-b9e8-4ca1-9d23-bff9a65edf60 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.153888 Aug 30 02:03:31.744303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 520/1010] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:31 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:31.901593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7ec6a330-883f-4749-886d-cd4d47e98ce4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:31.902185 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7ec6a330-883f-4749-886d-cd4d47e98ce4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:31.908076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ec6a330-883f-4749-886d-cd4d47e98ce4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.908598 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ec6a330-883f-4749-886d-cd4d47e98ce4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.909034 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ec6a330-883f-4749-886d-cd4d47e98ce4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:31.909725 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ec6a330-883f-4749-886d-cd4d47e98ce4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.910180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ec6a330-883f-4749-886d-cd4d47e98ce4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.910602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ec6a330-883f-4749-886d-cd4d47e98ce4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.049607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7ec6a330-883f-4749-886d-cd4d47e98ce4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:32.057315 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7ec6a330-883f-4749-886d-cd4d47e98ce4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.160041 Aug 30 02:03:32.057870 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 491/1011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:31 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:32.562564 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:32.563177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:32.569405 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.569923 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.570366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.571065 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.572080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.572570 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.576736 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:32.604968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.605569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.606203 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.606319 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lazy-loading 'fault' on Instance uuid 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:03:32.678107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:32.686036 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-861e4955-9f40-45b7-99ef-29eace1264df tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 200 len: 1332 microversion: 2.1 time: 0.127250 Aug 30 02:03:32.686919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 521/1012] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:32 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:32.698583 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3cf8e985-3650-425f-a100-4b0d779c9a23 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:32.700896 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3cf8e985-3650-425f-a100-4b0d779c9a23 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:32.707578 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3cf8e985-3650-425f-a100-4b0d779c9a23 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.708114 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3cf8e985-3650-425f-a100-4b0d779c9a23 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.708582 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3cf8e985-3650-425f-a100-4b0d779c9a23 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.709470 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3cf8e985-3650-425f-a100-4b0d779c9a23 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.709928 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3cf8e985-3650-425f-a100-4b0d779c9a23 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.710353 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3cf8e985-3650-425f-a100-4b0d779c9a23 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.743180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3cf8e985-3650-425f-a100-4b0d779c9a23 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048979 Aug 30 02:03:32.743731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 492/1013] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:03:32 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:32.765272 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-839604a6-7c6f-4005-8888-d622bc885cf2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:32.765882 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-839604a6-7c6f-4005-8888-d622bc885cf2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:32.772169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-839604a6-7c6f-4005-8888-d622bc885cf2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.772680 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-839604a6-7c6f-4005-8888-d622bc885cf2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.773116 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-839604a6-7c6f-4005-8888-d622bc885cf2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.773799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-839604a6-7c6f-4005-8888-d622bc885cf2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.774273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-839604a6-7c6f-4005-8888-d622bc885cf2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.775227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-839604a6-7c6f-4005-8888-d622bc885cf2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.806842 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6eea741d-a25f-4464-a2a4-1dbb75a47619 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:32.807517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6eea741d-a25f-4464-a2a4-1dbb75a47619 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:32.813628 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6eea741d-a25f-4464-a2a4-1dbb75a47619 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.814118 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6eea741d-a25f-4464-a2a4-1dbb75a47619 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.814564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6eea741d-a25f-4464-a2a4-1dbb75a47619 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.815257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6eea741d-a25f-4464-a2a4-1dbb75a47619 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.815713 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6eea741d-a25f-4464-a2a4-1dbb75a47619 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.816145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6eea741d-a25f-4464-a2a4-1dbb75a47619 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.842020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6eea741d-a25f-4464-a2a4-1dbb75a47619 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:03:32.908847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-839604a6-7c6f-4005-8888-d622bc885cf2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:32.917277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-839604a6-7c6f-4005-8888-d622bc885cf2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.155881 Aug 30 02:03:32.917917 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 522/1014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:32 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:32.920017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6eea741d-a25f-4464-a2a4-1dbb75a47619 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "DELETE /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 204 len: 0 microversion: 2.20 time: 0.116820 Aug 30 02:03:32.923659 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 493/1015] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 02:03:32 2022] DELETE /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 02:03:32.933386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:32.934041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:32.940628 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.941290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.941989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.942784 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.943361 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.943891 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:33.078573 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f2a65a91-1e16-44b2-805e-84b5e10c2d60 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:33.079302 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f2a65a91-1e16-44b2-805e-84b5e10c2d60 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:33.083640 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:33.085389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2a65a91-1e16-44b2-805e-84b5e10c2d60 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:33.085872 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2a65a91-1e16-44b2-805e-84b5e10c2d60 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:33.086307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2a65a91-1e16-44b2-805e-84b5e10c2d60 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:33.087591 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2a65a91-1e16-44b2-805e-84b5e10c2d60 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:33.088037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2a65a91-1e16-44b2-805e-84b5e10c2d60 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:33.088488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f2a65a91-1e16-44b2-805e-84b5e10c2d60 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:33.092224 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:33.093718 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:33.094873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-05729c97-ed64-4ab6-91fb-50f0880274a4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.170071 Aug 30 02:03:33.095438 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 523/1016] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:32 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:03:33.215182 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f2a65a91-1e16-44b2-805e-84b5e10c2d60 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:33.218710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:33.223631 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f2a65a91-1e16-44b2-805e-84b5e10c2d60 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.149221 Aug 30 02:03:33.224182 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 494/1017] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:33 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:33.707078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:33.707690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:33.713731 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:33.714238 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:33.714674 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:33.715355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:33.715806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:33.716225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:33.731295 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 HTTP/1.1 Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:03:33.732941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:03:33.734549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '93f56e8b-8c6b-469a-a47d-40fb70a05cb0'} Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:03:33.735643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:03:33.737225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:33.738671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:03:33.738671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-963f6fb9-fdc8-4280-9c5b-d1becefa7d1d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 404 len: 111 microversion: 2.1 time: 0.031069 Aug 30 02:03:33.738671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 524/1018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:33 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:03:33.743088 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c43ba8ae-6ead-45e9-a90f-68e57fec5436 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '.version_select at 0x7f3b08026550>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:33.764444 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c43ba8ae-6ead-45e9-a90f-68e57fec5436 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064451567" status: 202 len: 0 microversion: 2.1 time: 0.025081 Aug 30 02:03:33.764993 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 495/1019] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 02:03:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064451567 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:03:33.939789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0422cd01-eaff-4f54-8e06-62205454d897 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:33.940434 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0422cd01-eaff-4f54-8e06-62205454d897 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:33.947735 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0422cd01-eaff-4f54-8e06-62205454d897 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:33.948219 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0422cd01-eaff-4f54-8e06-62205454d897 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:33.948759 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0422cd01-eaff-4f54-8e06-62205454d897 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:33.949490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0422cd01-eaff-4f54-8e06-62205454d897 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:33.949943 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0422cd01-eaff-4f54-8e06-62205454d897 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:33.950369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0422cd01-eaff-4f54-8e06-62205454d897 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:34.118578 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:34.119190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:34.121047 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:34.128666 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:34.129160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:34.129605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:34.130326 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:34.130780 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:34.131205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:34.188391 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0422cd01-eaff-4f54-8e06-62205454d897 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:34.197499 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0422cd01-eaff-4f54-8e06-62205454d897 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.262344 Aug 30 02:03:34.211350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 525/1020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:33 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:34.244348 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ece78d64-8889-4736-8d9c-3057cf1e59b0 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:34.245100 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ece78d64-8889-4736-8d9c-3057cf1e59b0 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:34.251684 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ece78d64-8889-4736-8d9c-3057cf1e59b0 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:34.252311 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ece78d64-8889-4736-8d9c-3057cf1e59b0 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:34.252970 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ece78d64-8889-4736-8d9c-3057cf1e59b0 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:34.253681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ece78d64-8889-4736-8d9c-3057cf1e59b0 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:34.254139 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ece78d64-8889-4736-8d9c-3057cf1e59b0 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:34.254569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ece78d64-8889-4736-8d9c-3057cf1e59b0 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:34.268278 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:34.278114 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:34.279552 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:34.280777 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f9ae3df7-6ddd-4e8e-b084-225d43115d89 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.166748 Aug 30 02:03:34.290972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 496/1021] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:34 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:03:34.461239 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ece78d64-8889-4736-8d9c-3057cf1e59b0 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:34.469939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ece78d64-8889-4736-8d9c-3057cf1e59b0 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.229550 Aug 30 02:03:34.470537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 526/1022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:34 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:34.831791 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8fbbaa22-1ed1-4477-9d25-e6a91770360b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:34.832346 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8fbbaa22-1ed1-4477-9d25-e6a91770360b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:34.838747 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fbbaa22-1ed1-4477-9d25-e6a91770360b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:34.839230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fbbaa22-1ed1-4477-9d25-e6a91770360b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:34.839660 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fbbaa22-1ed1-4477-9d25-e6a91770360b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:34.840381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fbbaa22-1ed1-4477-9d25-e6a91770360b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:34.840836 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fbbaa22-1ed1-4477-9d25-e6a91770360b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:34.841260 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8fbbaa22-1ed1-4477-9d25-e6a91770360b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:34.923377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-8fbbaa22-1ed1-4477-9d25-e6a91770360b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lazy-loading 'services' on Instance uuid 22f76949-51c7-4027-bca6-70e517d28eec {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:03:34.995508 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8fbbaa22-1ed1-4477-9d25-e6a91770360b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments/13ce3103-585a-4205-84e3-1d93ffc48741" status: 202 len: 0 microversion: 2.1 time: 0.167445 Aug 30 02:03:34.996268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 497/1023] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:03:34 2022] DELETE /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments/13ce3103-585a-4205-84e3-1d93ffc48741 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:03:35.004537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-eb32c663-1d45-496e-a35a-56906bab72bf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:35.006799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-eb32c663-1d45-496e-a35a-56906bab72bf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:35.016827 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb32c663-1d45-496e-a35a-56906bab72bf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:35.017320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb32c663-1d45-496e-a35a-56906bab72bf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:35.017823 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb32c663-1d45-496e-a35a-56906bab72bf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:35.018754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb32c663-1d45-496e-a35a-56906bab72bf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:35.019314 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb32c663-1d45-496e-a35a-56906bab72bf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:35.019833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eb32c663-1d45-496e-a35a-56906bab72bf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:35.051251 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-eb32c663-1d45-496e-a35a-56906bab72bf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050694 Aug 30 02:03:35.051808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 527/1024] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:03:34 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:35.220579 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1d9289fd-850d-457c-9204-f4814d72a448 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:35.221283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1d9289fd-850d-457c-9204-f4814d72a448 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:35.227445 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d9289fd-850d-457c-9204-f4814d72a448 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:35.227935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d9289fd-850d-457c-9204-f4814d72a448 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:35.228431 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d9289fd-850d-457c-9204-f4814d72a448 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:35.229449 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d9289fd-850d-457c-9204-f4814d72a448 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:35.229977 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d9289fd-850d-457c-9204-f4814d72a448 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:35.230500 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d9289fd-850d-457c-9204-f4814d72a448 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:35.302948 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:35.303557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:35.309491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:35.309970 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:35.310404 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:35.311096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:35.311545 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:35.312233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:35.362929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1d9289fd-850d-457c-9204-f4814d72a448 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:35.371338 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1d9289fd-850d-457c-9204-f4814d72a448 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.155910 Aug 30 02:03:35.371900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 498/1025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:35 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:35.444723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:35.456182 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:35.457643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:35.458824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2559ebf9-ffa3-4e1d-83fc-7ee3e532bd4c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.159778 Aug 30 02:03:35.459376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 528/1026] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:35 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:35.490689 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3992d2ae-e0ae-4d31-bdf6-017b3180c542 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:35.491303 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3992d2ae-e0ae-4d31-bdf6-017b3180c542 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:35.497720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3992d2ae-e0ae-4d31-bdf6-017b3180c542 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:35.498204 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3992d2ae-e0ae-4d31-bdf6-017b3180c542 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:35.498637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3992d2ae-e0ae-4d31-bdf6-017b3180c542 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:35.499322 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3992d2ae-e0ae-4d31-bdf6-017b3180c542 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:35.499773 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3992d2ae-e0ae-4d31-bdf6-017b3180c542 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:35.500195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3992d2ae-e0ae-4d31-bdf6-017b3180c542 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:35.627924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3992d2ae-e0ae-4d31-bdf6-017b3180c542 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:35.636336 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3992d2ae-e0ae-4d31-bdf6-017b3180c542 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.149551 Aug 30 02:03:35.636893 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 499/1027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:35 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:36.063593 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1cb08d33-5f5b-405d-bade-059aed2b0de9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:36.065869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1cb08d33-5f5b-405d-bade-059aed2b0de9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:36.072557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cb08d33-5f5b-405d-bade-059aed2b0de9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:36.073043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cb08d33-5f5b-405d-bade-059aed2b0de9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:36.073486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cb08d33-5f5b-405d-bade-059aed2b0de9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:36.074186 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cb08d33-5f5b-405d-bade-059aed2b0de9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:36.074645 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cb08d33-5f5b-405d-bade-059aed2b0de9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:36.075076 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1cb08d33-5f5b-405d-bade-059aed2b0de9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:36.105321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1cb08d33-5f5b-405d-bade-059aed2b0de9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045683 Aug 30 02:03:36.105878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 529/1028] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:03:36 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:36.393111 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e4c21515-472e-4097-a5ec-b79deefffd36 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:36.393677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e4c21515-472e-4097-a5ec-b79deefffd36 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:36.400671 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4c21515-472e-4097-a5ec-b79deefffd36 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:36.401147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4c21515-472e-4097-a5ec-b79deefffd36 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:36.401575 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4c21515-472e-4097-a5ec-b79deefffd36 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:36.402253 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4c21515-472e-4097-a5ec-b79deefffd36 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:36.402697 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4c21515-472e-4097-a5ec-b79deefffd36 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:36.403116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4c21515-472e-4097-a5ec-b79deefffd36 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:36.481615 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:36.482231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:36.488708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:36.489195 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:36.489637 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:36.490338 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:36.490799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:36.491231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:36.530599 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e4c21515-472e-4097-a5ec-b79deefffd36 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:36.541057 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e4c21515-472e-4097-a5ec-b79deefffd36 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.151850 Aug 30 02:03:36.541627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 500/1029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:36 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:36.616789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:36.624747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:36.626242 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:36.627402 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9d3017ec-ce77-4f9e-9342-93d75d225f73 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.149680 Aug 30 02:03:36.627953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 530/1030] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:36 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:03:36.656395 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b9657ad2-cc8e-424c-ac67-a7fb181105ce tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:36.656945 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b9657ad2-cc8e-424c-ac67-a7fb181105ce tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:36.662839 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9657ad2-cc8e-424c-ac67-a7fb181105ce tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:36.663322 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9657ad2-cc8e-424c-ac67-a7fb181105ce tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:36.663757 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9657ad2-cc8e-424c-ac67-a7fb181105ce tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:36.664466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9657ad2-cc8e-424c-ac67-a7fb181105ce tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:36.664919 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9657ad2-cc8e-424c-ac67-a7fb181105ce tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:36.665374 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b9657ad2-cc8e-424c-ac67-a7fb181105ce tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:36.796863 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b9657ad2-cc8e-424c-ac67-a7fb181105ce tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:36.804358 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b9657ad2-cc8e-424c-ac67-a7fb181105ce tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.151863 Aug 30 02:03:36.804920 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 501/1031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:36 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:37.117725 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7c849fed-3647-4ab9-9037-fd31b70b346b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:37.119902 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7c849fed-3647-4ab9-9037-fd31b70b346b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:37.126179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7c849fed-3647-4ab9-9037-fd31b70b346b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:37.126653 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7c849fed-3647-4ab9-9037-fd31b70b346b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:37.127085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7c849fed-3647-4ab9-9037-fd31b70b346b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:37.127765 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7c849fed-3647-4ab9-9037-fd31b70b346b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:37.128211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7c849fed-3647-4ab9-9037-fd31b70b346b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:37.128661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7c849fed-3647-4ab9-9037-fd31b70b346b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:37.157709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7c849fed-3647-4ab9-9037-fd31b70b346b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 Aug 30 02:03:37.158237 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 531/1032] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:03:37 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:37.561881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ccdbce89-3a8d-4497-9070-f845b5528148 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:37.562487 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ccdbce89-3a8d-4497-9070-f845b5528148 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:37.568906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdbce89-3a8d-4497-9070-f845b5528148 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:37.569383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdbce89-3a8d-4497-9070-f845b5528148 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:37.569810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdbce89-3a8d-4497-9070-f845b5528148 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:37.570489 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdbce89-3a8d-4497-9070-f845b5528148 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:37.570938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdbce89-3a8d-4497-9070-f845b5528148 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:37.571857 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccdbce89-3a8d-4497-9070-f845b5528148 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:37.651090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:37.651696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:37.657628 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:37.658121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:37.658551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:37.659242 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:37.659694 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:37.660149 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:37.697966 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ccdbce89-3a8d-4497-9070-f845b5528148 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:37.706117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ccdbce89-3a8d-4497-9070-f845b5528148 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.148046 Aug 30 02:03:37.706683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 502/1033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:37 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:37.789080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:37.797210 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:37.798637 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:37.799772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-50f4fb2d-bd19-45c1-90cb-2814a9d5adff tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.152812 Aug 30 02:03:37.800335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 532/1034] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:37 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:03:37.825308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9be8487e-1b1f-47e4-92b2-b8a5ff5fb1b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:37.825874 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9be8487e-1b1f-47e4-92b2-b8a5ff5fb1b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:37.831779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9be8487e-1b1f-47e4-92b2-b8a5ff5fb1b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:37.832282 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9be8487e-1b1f-47e4-92b2-b8a5ff5fb1b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:37.832722 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9be8487e-1b1f-47e4-92b2-b8a5ff5fb1b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:37.833409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9be8487e-1b1f-47e4-92b2-b8a5ff5fb1b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:37.833857 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9be8487e-1b1f-47e4-92b2-b8a5ff5fb1b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:37.834303 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9be8487e-1b1f-47e4-92b2-b8a5ff5fb1b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:37.964827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9be8487e-1b1f-47e4-92b2-b8a5ff5fb1b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:37.972505 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9be8487e-1b1f-47e4-92b2-b8a5ff5fb1b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.151589 Aug 30 02:03:37.973061 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 503/1035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:37 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:38.169935 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-48a4e274-1953-492e-ace2-8e49682c2a1f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:38.171998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-48a4e274-1953-492e-ace2-8e49682c2a1f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:38.178404 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-48a4e274-1953-492e-ace2-8e49682c2a1f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:38.178890 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-48a4e274-1953-492e-ace2-8e49682c2a1f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:38.179334 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-48a4e274-1953-492e-ace2-8e49682c2a1f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:38.180027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-48a4e274-1953-492e-ace2-8e49682c2a1f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:38.180558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-48a4e274-1953-492e-ace2-8e49682c2a1f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:38.180994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-48a4e274-1953-492e-ace2-8e49682c2a1f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:38.210019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-48a4e274-1953-492e-ace2-8e49682c2a1f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044107 Aug 30 02:03:38.210542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 533/1036] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:03:38 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:38.726871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-91deb564-f496-45ea-bb2e-7ab9f2f40890 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:38.727898 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-91deb564-f496-45ea-bb2e-7ab9f2f40890 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:38.734335 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91deb564-f496-45ea-bb2e-7ab9f2f40890 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:38.734818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91deb564-f496-45ea-bb2e-7ab9f2f40890 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:38.735251 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91deb564-f496-45ea-bb2e-7ab9f2f40890 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:38.735936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91deb564-f496-45ea-bb2e-7ab9f2f40890 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:38.736422 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91deb564-f496-45ea-bb2e-7ab9f2f40890 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:38.736848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-91deb564-f496-45ea-bb2e-7ab9f2f40890 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:38.822714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:38.823320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:38.829357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:38.829833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:38.830263 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:38.830947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:38.831392 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:38.831812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:38.872612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-91deb564-f496-45ea-bb2e-7ab9f2f40890 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:38.880362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-91deb564-f496-45ea-bb2e-7ab9f2f40890 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.157338 Aug 30 02:03:38.880933 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 504/1037] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:38 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:38.993425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f50b32b0-88b1-4dce-8f01-a83af05615c4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:38.994165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f50b32b0-88b1-4dce-8f01-a83af05615c4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:38.998416 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:39.000365 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f50b32b0-88b1-4dce-8f01-a83af05615c4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:39.000859 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f50b32b0-88b1-4dce-8f01-a83af05615c4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:39.001297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f50b32b0-88b1-4dce-8f01-a83af05615c4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:39.002002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f50b32b0-88b1-4dce-8f01-a83af05615c4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:39.002460 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f50b32b0-88b1-4dce-8f01-a83af05615c4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:39.002888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f50b32b0-88b1-4dce-8f01-a83af05615c4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:39.006626 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:39.008453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:39.010170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8aab7f8d-9517-4a65-88e3-7081fc445f4e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1721 microversion: 2.20 time: 0.191206 Aug 30 02:03:39.010748 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 534/1038] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:38 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:03:39.130543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f50b32b0-88b1-4dce-8f01-a83af05615c4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:39.139013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f50b32b0-88b1-4dce-8f01-a83af05615c4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.149567 Aug 30 02:03:39.139575 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 505/1039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:38 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:39.222621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ae93a670-a2d8-4e16-b505-0794755d7656 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:39.224886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ae93a670-a2d8-4e16-b505-0794755d7656 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:39.231839 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ae93a670-a2d8-4e16-b505-0794755d7656 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:39.232361 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ae93a670-a2d8-4e16-b505-0794755d7656 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:39.232809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ae93a670-a2d8-4e16-b505-0794755d7656 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:39.233817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ae93a670-a2d8-4e16-b505-0794755d7656 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:39.233938 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ae93a670-a2d8-4e16-b505-0794755d7656 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:39.234366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ae93a670-a2d8-4e16-b505-0794755d7656 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:39.264386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ae93a670-a2d8-4e16-b505-0794755d7656 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045669 Aug 30 02:03:39.264923 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 535/1040] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:03:39 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:39.902605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1d6beac1-abac-42ef-984a-8573f8661537 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:39.903357 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1d6beac1-abac-42ef-984a-8573f8661537 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:39.910888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d6beac1-abac-42ef-984a-8573f8661537 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:39.911515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d6beac1-abac-42ef-984a-8573f8661537 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:39.912053 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d6beac1-abac-42ef-984a-8573f8661537 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:39.912924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d6beac1-abac-42ef-984a-8573f8661537 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:39.913491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d6beac1-abac-42ef-984a-8573f8661537 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:39.914015 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d6beac1-abac-42ef-984a-8573f8661537 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:40.033907 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:40.034514 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:40.045741 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:40.046219 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:40.046651 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:40.047371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:40.047799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:40.048451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:40.059138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1d6beac1-abac-42ef-984a-8573f8661537 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:40.068515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1d6beac1-abac-42ef-984a-8573f8661537 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.170414 Aug 30 02:03:40.069367 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 506/1041] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:39 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:40.160644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-53470769-89cb-4378-879c-1912f1d873be tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:40.161626 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-53470769-89cb-4378-879c-1912f1d873be tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:40.166698 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:40.181301 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:40.183417 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53470769-89cb-4378-879c-1912f1d873be tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:40.185236 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:40.185946 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53470769-89cb-4378-879c-1912f1d873be tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:40.186568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53470769-89cb-4378-879c-1912f1d873be tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:40.187608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53470769-89cb-4378-879c-1912f1d873be tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:40.188830 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53470769-89cb-4378-879c-1912f1d873be tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:40.189772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b0d2bd17-e6a2-49b7-a6ef-85cd49d0f2cf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1653 microversion: 2.20 time: 0.160034 Aug 30 02:03:40.190399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53470769-89cb-4378-879c-1912f1d873be tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:40.193656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 536/1042] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:40 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:40.278533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-bc2e7dbb-7baf-4342-a4d3-e396d9532d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:40.280706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-bc2e7dbb-7baf-4342-a4d3-e396d9532d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:40.295680 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc2e7dbb-7baf-4342-a4d3-e396d9532d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:40.296602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc2e7dbb-7baf-4342-a4d3-e396d9532d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:40.297107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc2e7dbb-7baf-4342-a4d3-e396d9532d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:40.297886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc2e7dbb-7baf-4342-a4d3-e396d9532d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:40.298762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc2e7dbb-7baf-4342-a4d3-e396d9532d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:40.299103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-bc2e7dbb-7baf-4342-a4d3-e396d9532d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:40.335332 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-bc2e7dbb-7baf-4342-a4d3-e396d9532d3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062722 Aug 30 02:03:40.335906 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 537/1043] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:03:40 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:03:40.380863 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-53470769-89cb-4378-879c-1912f1d873be tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:40.391693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-53470769-89cb-4378-879c-1912f1d873be tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.235800 Aug 30 02:03:40.392987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 507/1044] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:40 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:40.512637 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-caebef43-3396-4580-a029-cfb754202796 req-9eba01f8-ee46-4a14-8f35-ff09473a070b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51036535-5cf5-4283-b501-b0809e3f57a6", "name": "network-vif-deleted", "tag": "b76470f7-925f-4c0c-b128-d7b4fbc6e636"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:40.526160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-caebef43-3396-4580-a029-cfb754202796 req-9eba01f8-ee46-4a14-8f35-ff09473a070b service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:40.527257 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-caebef43-3396-4580-a029-cfb754202796 req-9eba01f8-ee46-4a14-8f35-ff09473a070b service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:40.527693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-caebef43-3396-4580-a029-cfb754202796 req-9eba01f8-ee46-4a14-8f35-ff09473a070b service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:40.531627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=100 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:40.541473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-caebef43-3396-4580-a029-cfb754202796 req-9eba01f8-ee46-4a14-8f35-ff09473a070b service nova] Creating event network-vif-deleted:b76470f7-925f-4c0c-b128-d7b4fbc6e636 for instance 51036535-5cf5-4283-b501-b0809e3f57a6 on hv-cinder-81966 Aug 30 02:03:40.550067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-caebef43-3396-4580-a029-cfb754202796 req-9eba01f8-ee46-4a14-8f35-ff09473a070b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040900 Aug 30 02:03:40.550744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 538/1045] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:41.091592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b57043e9-b833-48d7-a57f-89b4387fdcba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:41.092794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b57043e9-b833-48d7-a57f-89b4387fdcba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:41.099013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b57043e9-b833-48d7-a57f-89b4387fdcba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.099502 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b57043e9-b833-48d7-a57f-89b4387fdcba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.100125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b57043e9-b833-48d7-a57f-89b4387fdcba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.100865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b57043e9-b833-48d7-a57f-89b4387fdcba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.101325 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b57043e9-b833-48d7-a57f-89b4387fdcba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.101759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b57043e9-b833-48d7-a57f-89b4387fdcba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.220943 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:41.221677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:41.229726 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.230298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.231021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.231827 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.232379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.232953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.236320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b57043e9-b833-48d7-a57f-89b4387fdcba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:41.250714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b57043e9-b833-48d7-a57f-89b4387fdcba tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.164223 Aug 30 02:03:41.259711 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 508/1046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:41 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:41.283349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.284955 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.285620 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.286465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lazy-loading 'fault' on Instance uuid 51036535-5cf5-4283-b501-b0809e3f57a6 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:03:41.329598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:41.338824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:41.341773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:41.346972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-174aa155-9e9b-4eef-b4d1-1103515ee5ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:41.349281 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-174aa155-9e9b-4eef-b4d1-1103515ee5ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:41.353372 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-28b9417d-8b3b-4575-b707-e5b47a66f13e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1369 microversion: 2.20 time: 0.136833 Aug 30 02:03:41.354122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 539/1047] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:41 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1369 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:03:41.361052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-174aa155-9e9b-4eef-b4d1-1103515ee5ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.361543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-174aa155-9e9b-4eef-b4d1-1103515ee5ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.361976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-174aa155-9e9b-4eef-b4d1-1103515ee5ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.362730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-174aa155-9e9b-4eef-b4d1-1103515ee5ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.363201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-174aa155-9e9b-4eef-b4d1-1103515ee5ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.363633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-174aa155-9e9b-4eef-b4d1-1103515ee5ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.417237 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d47ae414-2129-446a-9c9d-41fa73018edc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:41.418241 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d47ae414-2129-446a-9c9d-41fa73018edc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:41.427037 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d47ae414-2129-446a-9c9d-41fa73018edc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.428043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d47ae414-2129-446a-9c9d-41fa73018edc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.428977 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d47ae414-2129-446a-9c9d-41fa73018edc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.430057 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d47ae414-2129-446a-9c9d-41fa73018edc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.431658 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d47ae414-2129-446a-9c9d-41fa73018edc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.432343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d47ae414-2129-446a-9c9d-41fa73018edc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.436589 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-174aa155-9e9b-4eef-b4d1-1103515ee5ad tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093198 Aug 30 02:03:41.437580 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 509/1048] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:03:41 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 02:03:41.521039 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6cdef288-5ec7-4237-b240-713c142fe776 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:41.521787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6cdef288-5ec7-4237-b240-713c142fe776 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:41.532742 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cdef288-5ec7-4237-b240-713c142fe776 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.533243 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cdef288-5ec7-4237-b240-713c142fe776 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.533674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cdef288-5ec7-4237-b240-713c142fe776 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.538931 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cdef288-5ec7-4237-b240-713c142fe776 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.541662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cdef288-5ec7-4237-b240-713c142fe776 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.542327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6cdef288-5ec7-4237-b240-713c142fe776 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.575193 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6cdef288-5ec7-4237-b240-713c142fe776 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:03:41.627601 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d47ae414-2129-446a-9c9d-41fa73018edc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:41.632292 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:41.639164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d47ae414-2129-446a-9c9d-41fa73018edc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.229773 Aug 30 02:03:41.639747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 540/1049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:41 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:41.687290 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6cdef288-5ec7-4237-b240-713c142fe776 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 204 len: 0 microversion: 2.1 time: 0.179013 Aug 30 02:03:41.691325 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 510/1050] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:03:41 2022] DELETE /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 02:03:41.702060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-65b076fb-dfb0-4ed5-b985-1ff3cee23208 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:41.702681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-65b076fb-dfb0-4ed5-b985-1ff3cee23208 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:41.709831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65b076fb-dfb0-4ed5-b985-1ff3cee23208 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.710505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65b076fb-dfb0-4ed5-b985-1ff3cee23208 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.711055 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65b076fb-dfb0-4ed5-b985-1ff3cee23208 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.711858 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65b076fb-dfb0-4ed5-b985-1ff3cee23208 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.712437 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65b076fb-dfb0-4ed5-b985-1ff3cee23208 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.712937 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65b076fb-dfb0-4ed5-b985-1ff3cee23208 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.842428 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-65b076fb-dfb0-4ed5-b985-1ff3cee23208 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:41.849936 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-65b076fb-dfb0-4ed5-b985-1ff3cee23208 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1680 microversion: 2.1 time: 0.152007 Aug 30 02:03:41.850492 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 541/1051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:41 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:42.277512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ff696ed0-ab50-4595-951e-4950e92bbb3a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:42.278219 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ff696ed0-ab50-4595-951e-4950e92bbb3a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:42.284900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff696ed0-ab50-4595-951e-4950e92bbb3a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.285421 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff696ed0-ab50-4595-951e-4950e92bbb3a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.285869 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff696ed0-ab50-4595-951e-4950e92bbb3a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.286568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff696ed0-ab50-4595-951e-4950e92bbb3a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.287018 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff696ed0-ab50-4595-951e-4950e92bbb3a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.287434 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff696ed0-ab50-4595-951e-4950e92bbb3a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.379094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:42.380534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:42.388864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.389528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.390152 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.391028 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.391639 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.392232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.437815 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ff696ed0-ab50-4595-951e-4950e92bbb3a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:42.437996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.438345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.438778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.439410 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lazy-loading 'fault' on Instance uuid 51036535-5cf5-4283-b501-b0809e3f57a6 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:03:42.449435 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ff696ed0-ab50-4595-951e-4950e92bbb3a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.176698 Aug 30 02:03:42.450071 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 511/1052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:42 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:42.482662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-589b4481-6417-4d8b-b7db-999b74dca703 req-676eae53-0c77-4464-8961-e83994219382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0ed5413-5513-4b3f-8588-34ba725fff26", "name": "network-vif-plugged", "status": "completed", "tag": "368b4b69-ee2c-423b-823b-2d0eae43ecae"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:42.506923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-589b4481-6417-4d8b-b7db-999b74dca703 req-676eae53-0c77-4464-8961-e83994219382 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.507404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-589b4481-6417-4d8b-b7db-999b74dca703 req-676eae53-0c77-4464-8961-e83994219382 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.508088 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-589b4481-6417-4d8b-b7db-999b74dca703 req-676eae53-0c77-4464-8961-e83994219382 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.517866 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:42.520720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-589b4481-6417-4d8b-b7db-999b74dca703 req-676eae53-0c77-4464-8961-e83994219382 service nova] Creating event network-vif-plugged:368b4b69-ee2c-423b-823b-2d0eae43ecae for instance b0ed5413-5513-4b3f-8588-34ba725fff26 on hv-cinder-81966 Aug 30 02:03:42.526397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-589b4481-6417-4d8b-b7db-999b74dca703 req-676eae53-0c77-4464-8961-e83994219382 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049120 Aug 30 02:03:42.526977 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 512/1053] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:42.532929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:42.534651 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:42.535949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8b1dd2d9-46d2-4292-a16f-16a8f3d035fe tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 200 len: 1369 microversion: 2.20 time: 0.160757 Aug 30 02:03:42.536620 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 542/1054] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:42 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:42.662258 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fbd50749-9fa2-41a5-bfc5-171243c68914 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:42.662919 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fbd50749-9fa2-41a5-bfc5-171243c68914 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:42.669093 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbd50749-9fa2-41a5-bfc5-171243c68914 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.669565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbd50749-9fa2-41a5-bfc5-171243c68914 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.669993 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbd50749-9fa2-41a5-bfc5-171243c68914 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.670671 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbd50749-9fa2-41a5-bfc5-171243c68914 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.671118 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbd50749-9fa2-41a5-bfc5-171243c68914 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.671534 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fbd50749-9fa2-41a5-bfc5-171243c68914 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.797822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fbd50749-9fa2-41a5-bfc5-171243c68914 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:42.805457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fbd50749-9fa2-41a5-bfc5-171243c68914 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.147518 Aug 30 02:03:42.806015 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 513/1055] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:42 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:42.871467 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-026f2267-a4ab-479a-aadf-210a15cfb6b8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:42.872120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-026f2267-a4ab-479a-aadf-210a15cfb6b8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:42.879197 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-026f2267-a4ab-479a-aadf-210a15cfb6b8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.879679 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-026f2267-a4ab-479a-aadf-210a15cfb6b8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.880111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-026f2267-a4ab-479a-aadf-210a15cfb6b8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.880831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-026f2267-a4ab-479a-aadf-210a15cfb6b8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.881281 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-026f2267-a4ab-479a-aadf-210a15cfb6b8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.881703 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-026f2267-a4ab-479a-aadf-210a15cfb6b8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:43.169891 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-026f2267-a4ab-479a-aadf-210a15cfb6b8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:43.177671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-026f2267-a4ab-479a-aadf-210a15cfb6b8 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1680 microversion: 2.1 time: 0.310599 Aug 30 02:03:43.178239 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 543/1056] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:42 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1680 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:43.472226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2904bb3c-1370-48bc-aaa3-f8ea51cf0332 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:43.472876 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2904bb3c-1370-48bc-aaa3-f8ea51cf0332 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:43.479636 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2904bb3c-1370-48bc-aaa3-f8ea51cf0332 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:43.480138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2904bb3c-1370-48bc-aaa3-f8ea51cf0332 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:43.480601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2904bb3c-1370-48bc-aaa3-f8ea51cf0332 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:43.481296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2904bb3c-1370-48bc-aaa3-f8ea51cf0332 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:43.481775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2904bb3c-1370-48bc-aaa3-f8ea51cf0332 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:43.482166 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2904bb3c-1370-48bc-aaa3-f8ea51cf0332 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:43.559537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:43.559949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:43.566690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:43.567204 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:43.567710 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:43.568457 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:43.568930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:43.569360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:43.585453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] HTTP exception thrown: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Request method failure captured: Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 HTTP/1.1 Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4X64o39ZUiMuiHXUwPYD3C2Dul1nRGf51BW61E6BVedhHbJYm92v4XSQOsozco1v3ndr0kIxrKZhWCD-pCs8InLN3x2f3n9irXsxea_jImynDz66kDrrijn5rt6fJWcvfhKxCxpVodFHVJH4t3a5VlOkmh_jLOvSfsKpTvWxvU7A0 Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:03:43.587940 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b0db8e5fc6c48cc98136ef2a85b05f4"}]}] Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 85d2f3d2a8cb40d38d0ca2dc16609ef5 Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:03:43.590440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '51036535-5cf5-4283-b501-b0809e3f57a6'} Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:03:43.591248 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:03:43.592498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:03:43.594400 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Returning 404 to user: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:03:43.595642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-82a94b91-60ea-4be6-bf39-9bda2d087a3d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 404 len: 111 microversion: 2.20 time: 0.040783 Aug 30 02:03:43.596459 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 544/1057] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:43 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 02:03:43.606736 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3c1443b3-e7a2-4f63-b97f-a09dd13c3689 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '.version_select at 0x7f3b03f29ca0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:43.624766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2904bb3c-1370-48bc-aaa3-f8ea51cf0332 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:43.631386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3c1443b3-e7a2-4f63-b97f-a09dd13c3689 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-65531596" status: 204 len: 0 microversion: 2.20 time: 0.029999 Aug 30 02:03:43.631967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 545/1058] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 30 02:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-65531596 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 02:03:43.633684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2904bb3c-1370-48bc-aaa3-f8ea51cf0332 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.165245 Aug 30 02:03:43.634256 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 514/1059] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:43 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:43.826442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0e35bdf4-74e6-4b10-8084-6172c3d148b7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:43.827068 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0e35bdf4-74e6-4b10-8084-6172c3d148b7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:43.835450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0e35bdf4-74e6-4b10-8084-6172c3d148b7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:43.836220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0e35bdf4-74e6-4b10-8084-6172c3d148b7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:43.836724 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0e35bdf4-74e6-4b10-8084-6172c3d148b7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:43.837446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0e35bdf4-74e6-4b10-8084-6172c3d148b7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:43.837906 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0e35bdf4-74e6-4b10-8084-6172c3d148b7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:43.838358 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0e35bdf4-74e6-4b10-8084-6172c3d148b7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:44.063662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-1e37fa74-f767-44a1-8e2f-d623363fcce6 req-34dfea64-a752-445d-a8a4-e3dd8429492a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f76949-51c7-4027-bca6-70e517d28eec", "name": "network-vif-deleted", "tag": "33449dfd-7aea-47a8-bf04-2dbf480241dd"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:44.072131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0e35bdf4-74e6-4b10-8084-6172c3d148b7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:44.074546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-1e37fa74-f767-44a1-8e2f-d623363fcce6 req-34dfea64-a752-445d-a8a4-e3dd8429492a service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:44.075122 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-1e37fa74-f767-44a1-8e2f-d623363fcce6 req-34dfea64-a752-445d-a8a4-e3dd8429492a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:44.080192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0e35bdf4-74e6-4b10-8084-6172c3d148b7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1358 microversion: 2.1 time: 0.257681 Aug 30 02:03:44.080383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-1e37fa74-f767-44a1-8e2f-d623363fcce6 req-34dfea64-a752-445d-a8a4-e3dd8429492a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:44.081423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 546/1060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:43 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:44.106522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-1e37fa74-f767-44a1-8e2f-d623363fcce6 req-34dfea64-a752-445d-a8a4-e3dd8429492a service nova] Creating event network-vif-deleted:33449dfd-7aea-47a8-bf04-2dbf480241dd for instance 22f76949-51c7-4027-bca6-70e517d28eec on hv-cinder-81966 Aug 30 02:03:44.111897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-1e37fa74-f767-44a1-8e2f-d623363fcce6 req-34dfea64-a752-445d-a8a4-e3dd8429492a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055672 Aug 30 02:03:44.113158 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 515/1061] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:03:44.201808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0f90ac3a-b436-43a0-89ea-8184b3763337 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:44.202472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0f90ac3a-b436-43a0-89ea-8184b3763337 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:44.217002 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f90ac3a-b436-43a0-89ea-8184b3763337 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:44.217537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f90ac3a-b436-43a0-89ea-8184b3763337 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:44.217986 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f90ac3a-b436-43a0-89ea-8184b3763337 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:44.218732 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f90ac3a-b436-43a0-89ea-8184b3763337 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:44.219192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f90ac3a-b436-43a0-89ea-8184b3763337 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:44.224171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f90ac3a-b436-43a0-89ea-8184b3763337 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:44.360667 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0f90ac3a-b436-43a0-89ea-8184b3763337 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:44.377046 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0f90ac3a-b436-43a0-89ea-8184b3763337 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1613 microversion: 2.1 time: 0.181620 Aug 30 02:03:44.388808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 547/1062] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:44 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1613 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:44.420315 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3f8634e0-aa81-41fe-8669-ccb2cc9f81c7 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Action: 'create', calling method: .version_select at 0x7f3b08168940>, body: {"keypair": {"name": "tempest-keypair-1466193224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd8uOfhIuBcZTUUTIS9rB4lg1Zm7JgxQNQlyJS8nheo+ABsCPTlAowXmIO6+aKlFGTP5A7U8NRdeYk7Y6I4gFkmW0vT9UATJ3+zkS8nVPNE+o/mRAjwy1ugDfbh04qe1A=="}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:44.437488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-3f8634e0-aa81-41fe-8669-ccb2cc9f81c7 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Getting quotas for project 4b0db8e5fc6c48cc98136ef2a85b05f4. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:03:44.441787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-3f8634e0-aa81-41fe-8669-ccb2cc9f81c7 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Getting quotas for user 85d2f3d2a8cb40d38d0ca2dc16609ef5 and project 4b0db8e5fc6c48cc98136ef2a85b05f4. Resources: {'key_pairs'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:03:44.469393 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3f8634e0-aa81-41fe-8669-ccb2cc9f81c7 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.055670 Aug 30 02:03:44.479174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 516/1063] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 30 02:03:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 02:03:44.655255 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-29620ca5-fecc-4a5c-ae9c-d3efc1a0bf9d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:44.656001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-29620ca5-fecc-4a5c-ae9c-d3efc1a0bf9d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:44.669731 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-29620ca5-fecc-4a5c-ae9c-d3efc1a0bf9d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:44.670230 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-29620ca5-fecc-4a5c-ae9c-d3efc1a0bf9d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:44.670663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-29620ca5-fecc-4a5c-ae9c-d3efc1a0bf9d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:44.671364 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-29620ca5-fecc-4a5c-ae9c-d3efc1a0bf9d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:44.671899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-29620ca5-fecc-4a5c-ae9c-d3efc1a0bf9d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:44.672231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-29620ca5-fecc-4a5c-ae9c-d3efc1a0bf9d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:44.861489 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-29620ca5-fecc-4a5c-ae9c-d3efc1a0bf9d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:44.871569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-29620ca5-fecc-4a5c-ae9c-d3efc1a0bf9d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.219955 Aug 30 02:03:44.881432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 548/1064] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:44 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:45.102190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-708993b4-2784-47ad-98a5-fefaa0c61111 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:45.103095 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-708993b4-2784-47ad-98a5-fefaa0c61111 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:45.116384 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-708993b4-2784-47ad-98a5-fefaa0c61111 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.117221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-708993b4-2784-47ad-98a5-fefaa0c61111 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.119442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-708993b4-2784-47ad-98a5-fefaa0c61111 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.120627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-708993b4-2784-47ad-98a5-fefaa0c61111 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.121327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-708993b4-2784-47ad-98a5-fefaa0c61111 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.121973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-708993b4-2784-47ad-98a5-fefaa0c61111 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.398657 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:45.400026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:45.408667 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.409684 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.410430 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.411322 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.411939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.412557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.453530 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.454018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.454586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.455044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lazy-loading 'fault' on Instance uuid 22f76949-51c7-4027-bca6-70e517d28eec {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:03:45.457705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-708993b4-2784-47ad-98a5-fefaa0c61111 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:45.465677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-708993b4-2784-47ad-98a5-fefaa0c61111 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1548 microversion: 2.1 time: 0.367983 Aug 30 02:03:45.467327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 517/1065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:45 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1548 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:45.487509 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d06c90de-5c5d-43c5-bd46-4eb0eb3cf4ab tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:45.488128 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d06c90de-5c5d-43c5-bd46-4eb0eb3cf4ab tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:45.494583 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d06c90de-5c5d-43c5-bd46-4eb0eb3cf4ab tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.495272 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d06c90de-5c5d-43c5-bd46-4eb0eb3cf4ab tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.495991 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d06c90de-5c5d-43c5-bd46-4eb0eb3cf4ab tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.496880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d06c90de-5c5d-43c5-bd46-4eb0eb3cf4ab tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.497491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d06c90de-5c5d-43c5-bd46-4eb0eb3cf4ab tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.497905 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d06c90de-5c5d-43c5-bd46-4eb0eb3cf4ab tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.514064 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:45.522918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-428ac72a-41e1-4da5-9efd-98f15e49625e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 200 len: 1332 microversion: 2.1 time: 0.128249 Aug 30 02:03:45.523704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 549/1066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:45 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 1332 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:45.703042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d06c90de-5c5d-43c5-bd46-4eb0eb3cf4ab tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:45.710874 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d06c90de-5c5d-43c5-bd46-4eb0eb3cf4ab tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1548 microversion: 2.1 time: 0.227136 Aug 30 02:03:45.711433 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 518/1067] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:45 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:45.731024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:45.736021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:45.736840 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Searching by: {'deleted': False, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb'} {{(pid=120391) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 02:03:45.743846 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.744368 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.744917 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.745544 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.745980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.746429 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.839191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.multi_cell_list [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120391) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 02:03:45.894903 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6acbbc0d-4726-46ad-9ac0-44cf8d058498 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:45.895666 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6acbbc0d-4726-46ad-9ac0-44cf8d058498 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:45.903611 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6acbbc0d-4726-46ad-9ac0-44cf8d058498 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.904283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6acbbc0d-4726-46ad-9ac0-44cf8d058498 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.904853 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6acbbc0d-4726-46ad-9ac0-44cf8d058498 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.905800 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6acbbc0d-4726-46ad-9ac0-44cf8d058498 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.906367 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6acbbc0d-4726-46ad-9ac0-44cf8d058498 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.906892 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6acbbc0d-4726-46ad-9ac0-44cf8d058498 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.939271 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-483e5530-a6cf-40d9-9f28-7b0d4230427e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211826 Aug 30 02:03:45.939768 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 550/1068] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 30 02:03:45 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:45.951105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-21ef4577-fe71-4725-af95-38fbc092b82d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:45.951703 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-21ef4577-fe71-4725-af95-38fbc092b82d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:45.958189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21ef4577-fe71-4725-af95-38fbc092b82d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.958676 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21ef4577-fe71-4725-af95-38fbc092b82d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.959120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21ef4577-fe71-4725-af95-38fbc092b82d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.959796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21ef4577-fe71-4725-af95-38fbc092b82d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.960235 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21ef4577-fe71-4725-af95-38fbc092b82d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.960678 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21ef4577-fe71-4725-af95-38fbc092b82d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:46.115078 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-21ef4577-fe71-4725-af95-38fbc092b82d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:46.123859 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-21ef4577-fe71-4725-af95-38fbc092b82d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1548 microversion: 2.1 time: 0.176342 Aug 30 02:03:46.124465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 551/1069] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:45 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:46.139416 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6acbbc0d-4726-46ad-9ac0-44cf8d058498 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:46.149608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6acbbc0d-4726-46ad-9ac0-44cf8d058498 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1676 microversion: 2.1 time: 0.259270 Aug 30 02:03:46.150342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 519/1070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:45 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1676 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:46.367204 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-748721706", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "129ec4ac-29e2-47fa-a158-5c8fc9447c41"}], "security_groups": [{"name": "tempest-securitygroup--2143980173"}], "key_name": "tempest-keypair-1466193224", "user_data": "}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:46.485229 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.network.neutron [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] validate_networks() for [('129ec4ac-29e2-47fa-a158-5c8fc9447c41', None, None, None, None, None)] {{(pid=120391) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:03:46.545965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:46.546598 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:46.552409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:46.552901 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:46.553338 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:46.554025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:46.554479 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:46.554901 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:46.569107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec HTTP/1.1 Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:03:46.570775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:03:46.572359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '22f76949-51c7-4027-bca6-70e517d28eec'} Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:03:46.573206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:03:46.574401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:03:46.575463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:03:46.575463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4a55b851-4053-45e8-b68f-4048f0ce91f0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 404 len: 111 microversion: 2.1 time: 0.030489 Aug 30 02:03:46.575463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 520/1071] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:46 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:03:46.580851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-23444c34-0930-42ed-b073-5970c74bf4d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '.version_select at 0x7f3b08182820>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:46.600062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-23444c34-0930-42ed-b073-5970c74bf4d5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795287767" status: 202 len: 0 microversion: 2.1 time: 0.022780 Aug 30 02:03:46.600643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 521/1072] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 02:03:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795287767 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:03:47.073745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Flavor limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:03:47.074178 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Image limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:03:47.074629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Flavor pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:03:47.075037 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Image pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:03:47.075451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:03:47.084047 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:47.084560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:47.084989 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:47.085708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:47.086156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:47.087162 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:47.104396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Getting quotas for project 4b0db8e5fc6c48cc98136ef2a85b05f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:03:47.108340 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Getting quotas for user 85d2f3d2a8cb40d38d0ca2dc16609ef5 and project 4b0db8e5fc6c48cc98136ef2a85b05f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:03:47.111080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:47.121746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Going to run 1 instances... {{(pid=120391) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:03:47.124041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:03:47.173238 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bcef9efe-e382-4f6d-a27a-1b25c0840e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:47.174088 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-abebc9b7-91b0-40f8-8a1a-dd0f7a2be977 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.811305 Aug 30 02:03:47.174516 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bcef9efe-e382-4f6d-a27a-1b25c0840e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:47.180394 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 552/1073] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 30 02:03:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 02:03:47.186061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-24d6b579-bf69-4845-b8bf-bfd943164b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:47.187441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-24d6b579-bf69-4845-b8bf-bfd943164b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:47.205963 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bcef9efe-e382-4f6d-a27a-1b25c0840e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:47.206458 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bcef9efe-e382-4f6d-a27a-1b25c0840e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:47.206898 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bcef9efe-e382-4f6d-a27a-1b25c0840e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:47.207620 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bcef9efe-e382-4f6d-a27a-1b25c0840e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:47.208228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bcef9efe-e382-4f6d-a27a-1b25c0840e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:47.208676 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bcef9efe-e382-4f6d-a27a-1b25c0840e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:47.281384 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-24d6b579-bf69-4845-b8bf-bfd943164b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:47.289549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-24d6b579-bf69-4845-b8bf-bfd943164b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:47.291018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-24d6b579-bf69-4845-b8bf-bfd943164b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:47.292119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-24d6b579-bf69-4845-b8bf-bfd943164b75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1281 microversion: 2.20 time: 0.110575 Aug 30 02:03:47.292928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 553/1074] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:47 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:03:47.297788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-32ae633e-9fdc-4988-a2ba-54844cc6d3e7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: .version_select at 0x7f3b08154b80>, body: {"keypair": {"name": "tempest-keypair-603055405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwEifSYdlXUIkepCl5gtjATU0nQ8v5SChbMHCeq4dZFqXq7I6g/XBYb4FU9g5Rd5qb8YTHcMsxHnG20aJgYrUKEWmeY/cWGZs0nJPjCIJFrqsYQYB4NLZTXI5bGAPf3dw=="}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:47.314719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-32ae633e-9fdc-4988-a2ba-54844cc6d3e7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for project b9d96d936ce8417197008a59da394df7. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:03:47.318789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-32ae633e-9fdc-4988-a2ba-54844cc6d3e7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for user a06de37941264b979a3bd5aaf84ec73c and project b9d96d936ce8417197008a59da394df7. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:03:47.351369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-32ae633e-9fdc-4988-a2ba-54844cc6d3e7 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049925 Aug 30 02:03:47.352425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 554/1075] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 02:03:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:47.398116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bcef9efe-e382-4f6d-a27a-1b25c0840e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:47.407463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bcef9efe-e382-4f6d-a27a-1b25c0840e7c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1653 microversion: 2.1 time: 0.240260 Aug 30 02:03:47.408017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 522/1076] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:47 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1653 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:47.428566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5af8ac8e-9913-467d-85e5-b3502c021e80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:47.435382 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5af8ac8e-9913-467d-85e5-b3502c021e80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:47.435869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5af8ac8e-9913-467d-85e5-b3502c021e80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:47.436325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5af8ac8e-9913-467d-85e5-b3502c021e80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:47.460747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5af8ac8e-9913-467d-85e5-b3502c021e80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Going to try to start instance {{(pid=120391) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 02:03:47.522187 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5af8ac8e-9913-467d-85e5-b3502c021e80 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/action" status: 202 len: 0 microversion: 2.1 time: 0.093261 Aug 30 02:03:47.522187 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 555/1077] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:03:47 2022] POST /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:03:47.528050 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e88014bc-5396-4d31-94ad-8c7d97bca8a6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:47.528701 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e88014bc-5396-4d31-94ad-8c7d97bca8a6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:47.538734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e88014bc-5396-4d31-94ad-8c7d97bca8a6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:47.539289 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e88014bc-5396-4d31-94ad-8c7d97bca8a6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:47.542103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e88014bc-5396-4d31-94ad-8c7d97bca8a6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:47.545637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e88014bc-5396-4d31-94ad-8c7d97bca8a6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:47.546450 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e88014bc-5396-4d31-94ad-8c7d97bca8a6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:47.547288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e88014bc-5396-4d31-94ad-8c7d97bca8a6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:47.746822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e88014bc-5396-4d31-94ad-8c7d97bca8a6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:47.756828 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e88014bc-5396-4d31-94ad-8c7d97bca8a6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1662 microversion: 2.1 time: 0.232957 Aug 30 02:03:47.757635 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 523/1078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:47 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1662 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:47.820418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-21062fec-0e18-4db6-9e22-d39785cec824 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cac23e6b-f543-4675-916d-c0a0d2edc74e"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:47.822893 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-21062fec-0e18-4db6-9e22-d39785cec824 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:47.830262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21062fec-0e18-4db6-9e22-d39785cec824 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:47.830711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21062fec-0e18-4db6-9e22-d39785cec824 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:47.831146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21062fec-0e18-4db6-9e22-d39785cec824 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:47.831901 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21062fec-0e18-4db6-9e22-d39785cec824 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:47.832392 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21062fec-0e18-4db6-9e22-d39785cec824 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:47.833048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21062fec-0e18-4db6-9e22-d39785cec824 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:48.041909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:48.172491 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-21062fec-0e18-4db6-9e22-d39785cec824 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "POST /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356404 Aug 30 02:03:48.173493 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 556/1079] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 02:03:47 2022] POST /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:03:48.317762 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:48.318377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:48.326756 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:48.327246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:48.327683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:48.328427 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:48.335591 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:48.336308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:48.419530 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:48.437165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:48.438858 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:48.440198 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-40d99368-05d1-4bd7-9518-51fd00ef1256 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1333 microversion: 2.20 time: 0.126935 Aug 30 02:03:48.440787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 524/1080] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:48 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1333 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:48.779238 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b1b2776d-970e-4e50-bd0f-59cc44f5a49f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:48.779874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b1b2776d-970e-4e50-bd0f-59cc44f5a49f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:48.787559 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b1b2776d-970e-4e50-bd0f-59cc44f5a49f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:48.788043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b1b2776d-970e-4e50-bd0f-59cc44f5a49f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:48.788512 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b1b2776d-970e-4e50-bd0f-59cc44f5a49f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:48.789233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b1b2776d-970e-4e50-bd0f-59cc44f5a49f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:48.789678 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b1b2776d-970e-4e50-bd0f-59cc44f5a49f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:48.790098 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b1b2776d-970e-4e50-bd0f-59cc44f5a49f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:48.931415 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b1b2776d-970e-4e50-bd0f-59cc44f5a49f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:48.940513 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b1b2776d-970e-4e50-bd0f-59cc44f5a49f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1662 microversion: 2.1 time: 0.165517 Aug 30 02:03:48.941084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 557/1081] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:48 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1662 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:49.001065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1745702885", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71f52012-15ba-448d-9108-20629e1d18ee"}], "security_groups": [{"name": "tempest-securitygroup--2141259142"}], "key_name": "tempest-keypair-603055405", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:49.127474 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] validate_networks() for [('71f52012-15ba-448d-9108-20629e1d18ee', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:03:49.464534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:49.465120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:49.471828 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:49.472614 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:49.473041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:49.473770 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:49.474219 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:49.474641 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:49.538785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:49.547629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:49.549067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:49.550148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b49c2aea-827f-4aa8-a59b-7bc9fd73c350 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1341 microversion: 2.20 time: 0.089782 Aug 30 02:03:49.550696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 558/1082] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:49 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1341 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:03:49.745226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:03:49.745738 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:03:49.746282 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:03:49.746755 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:03:49.747279 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:03:49.756801 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:49.757359 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:49.757856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:49.758922 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:49.759435 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:49.759921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:49.778712 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for project b9d96d936ce8417197008a59da394df7. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:03:49.782739 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for user a06de37941264b979a3bd5aaf84ec73c and project b9d96d936ce8417197008a59da394df7. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:03:49.795171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:03:49.797522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:03:49.846855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4c74be38-d6ed-4a78-853f-2fb0a0f1da5f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.850215 Aug 30 02:03:49.847498 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 525/1083] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 02:03:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:03:49.858643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-95747b8c-4e6e-4659-a69d-8ffa72c119e2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:49.859342 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-95747b8c-4e6e-4659-a69d-8ffa72c119e2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:49.913965 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-95747b8c-4e6e-4659-a69d-8ffa72c119e2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:49.921249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-95747b8c-4e6e-4659-a69d-8ffa72c119e2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1241 microversion: 2.1 time: 0.066439 Aug 30 02:03:49.921959 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 559/1084] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:49 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:49.962775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-27ad2707-28d0-427a-a506-7b27667a236a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:49.963388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-27ad2707-28d0-427a-a506-7b27667a236a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:49.969802 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27ad2707-28d0-427a-a506-7b27667a236a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:49.970283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27ad2707-28d0-427a-a506-7b27667a236a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:49.970908 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27ad2707-28d0-427a-a506-7b27667a236a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:49.971601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27ad2707-28d0-427a-a506-7b27667a236a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:49.972054 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27ad2707-28d0-427a-a506-7b27667a236a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:49.972525 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-27ad2707-28d0-427a-a506-7b27667a236a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:50.110295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-27ad2707-28d0-427a-a506-7b27667a236a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:50.118365 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-27ad2707-28d0-427a-a506-7b27667a236a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1666 microversion: 2.1 time: 0.160129 Aug 30 02:03:50.118923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 526/1085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:49 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:50.575527 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:50.576793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:50.585528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:50.586709 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:50.587596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:50.588665 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:50.589126 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:50.589576 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:50.844234 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:50.852799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:50.855033 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:50.856154 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-04db1a51-9ca3-40d8-828b-548dbad3f951 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.285078 Aug 30 02:03:50.856908 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 560/1086] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:50 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:50.942873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-57afb725-9adc-4321-be93-6e85410d07d4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:50.943486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-57afb725-9adc-4321-be93-6e85410d07d4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:50.950624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57afb725-9adc-4321-be93-6e85410d07d4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:50.951103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57afb725-9adc-4321-be93-6e85410d07d4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:50.951533 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57afb725-9adc-4321-be93-6e85410d07d4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:50.952233 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57afb725-9adc-4321-be93-6e85410d07d4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:50.952702 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57afb725-9adc-4321-be93-6e85410d07d4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:50.953121 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57afb725-9adc-4321-be93-6e85410d07d4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:51.015824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-57afb725-9adc-4321-be93-6e85410d07d4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:51.023418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-57afb725-9adc-4321-be93-6e85410d07d4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1293 microversion: 2.1 time: 0.084847 Aug 30 02:03:51.024025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 527/1087] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:50 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:51.222570 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-b4d91e7a-e113-4f81-9c6b-b34d304314a9 req-8d89a579-e614-42c2-a7fc-5de9e7026bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df2b4ac0-60fb-4e49-9da3-039bcfff7698", "tag": "b9d05127-de36-4e30-a898-feeb840846d0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:51.232738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b4d91e7a-e113-4f81-9c6b-b34d304314a9 req-8d89a579-e614-42c2-a7fc-5de9e7026bee service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:51.233446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b4d91e7a-e113-4f81-9c6b-b34d304314a9 req-8d89a579-e614-42c2-a7fc-5de9e7026bee service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:51.234069 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b4d91e7a-e113-4f81-9c6b-b34d304314a9 req-8d89a579-e614-42c2-a7fc-5de9e7026bee service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:51.245596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-b4d91e7a-e113-4f81-9c6b-b34d304314a9 req-8d89a579-e614-42c2-a7fc-5de9e7026bee service nova] Creating event network-changed:b9d05127-de36-4e30-a898-feeb840846d0 for instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 on hv-cinder-81966 Aug 30 02:03:51.250596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-b4d91e7a-e113-4f81-9c6b-b34d304314a9 req-8d89a579-e614-42c2-a7fc-5de9e7026bee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031779 Aug 30 02:03:51.251192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 561/1088] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:03:51.878629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:51.879246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:51.886141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:51.886624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:51.887055 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:51.887744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:51.888195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:51.888646 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:52.020091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:52.028763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:52.030199 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:52.031305 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fe433674-a7ad-4b97-8027-38e974520443 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.156587 Aug 30 02:03:52.032067 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 528/1089] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:51 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:52.045369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a93734bf-5470-430c-8875-4af5b3bbe21c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:52.046189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a93734bf-5470-430c-8875-4af5b3bbe21c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:52.052589 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a93734bf-5470-430c-8875-4af5b3bbe21c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:52.053069 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a93734bf-5470-430c-8875-4af5b3bbe21c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:52.053512 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a93734bf-5470-430c-8875-4af5b3bbe21c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:52.054418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a93734bf-5470-430c-8875-4af5b3bbe21c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:52.055011 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a93734bf-5470-430c-8875-4af5b3bbe21c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:52.055466 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a93734bf-5470-430c-8875-4af5b3bbe21c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:52.121495 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a93734bf-5470-430c-8875-4af5b3bbe21c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:52.129075 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a93734bf-5470-430c-8875-4af5b3bbe21c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1299 microversion: 2.1 time: 0.089081 Aug 30 02:03:52.129633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 562/1090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:52 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:53.054301 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:53.055019 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:53.061261 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:53.062710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:53.063204 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:53.063645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:53.064393 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:53.064890 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:53.065317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:53.150106 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c882375a-cca9-43bc-b2f9-8883e756afb2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:53.150723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c882375a-cca9-43bc-b2f9-8883e756afb2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:53.161380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c882375a-cca9-43bc-b2f9-8883e756afb2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:53.161691 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c882375a-cca9-43bc-b2f9-8883e756afb2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:53.162131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c882375a-cca9-43bc-b2f9-8883e756afb2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:53.162845 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c882375a-cca9-43bc-b2f9-8883e756afb2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:53.163519 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c882375a-cca9-43bc-b2f9-8883e756afb2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:53.163951 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c882375a-cca9-43bc-b2f9-8883e756afb2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:53.208415 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:53.217381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:53.218856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:53.219989 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1d3cab4c-987f-4124-b53b-69d250c03b26 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.169638 Aug 30 02:03:53.220578 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 529/1091] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:53 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:53.293625 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c882375a-cca9-43bc-b2f9-8883e756afb2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:53.301244 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c882375a-cca9-43bc-b2f9-8883e756afb2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.155609 Aug 30 02:03:53.301796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 563/1092] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:53 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:54.241432 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:54.242059 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:54.248957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:54.249433 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:54.249861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:54.250539 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:54.250987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:54.251404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:54.321976 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a45a1e75-bec8-4633-a187-4d7d0387849e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:54.322588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a45a1e75-bec8-4633-a187-4d7d0387849e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:54.329127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a45a1e75-bec8-4633-a187-4d7d0387849e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:54.329605 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a45a1e75-bec8-4633-a187-4d7d0387849e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:54.330027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a45a1e75-bec8-4633-a187-4d7d0387849e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:54.331066 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a45a1e75-bec8-4633-a187-4d7d0387849e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:54.331163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a45a1e75-bec8-4633-a187-4d7d0387849e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:54.331564 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a45a1e75-bec8-4633-a187-4d7d0387849e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:54.381141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:54.389994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:54.391416 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:54.392533 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-acd32ef0-2156-469e-8848-6bfc99f0a383 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.155061 Aug 30 02:03:54.393083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 530/1093] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:54 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:54.461232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a45a1e75-bec8-4633-a187-4d7d0387849e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:54.468691 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a45a1e75-bec8-4633-a187-4d7d0387849e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.151165 Aug 30 02:03:54.469246 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 564/1094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:54 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:55.415407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:55.416011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:55.422680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:55.423160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:55.423585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:55.424280 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:55.424731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:55.425148 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:55.443749 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:55.489446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cd5b43bd-5ec0-4ddf-bbe5-bfb3da5878ba tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:55.490162 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cd5b43bd-5ec0-4ddf-bbe5-bfb3da5878ba tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:55.497563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd5b43bd-5ec0-4ddf-bbe5-bfb3da5878ba tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:55.497994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd5b43bd-5ec0-4ddf-bbe5-bfb3da5878ba tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:55.498434 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd5b43bd-5ec0-4ddf-bbe5-bfb3da5878ba tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:55.499130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd5b43bd-5ec0-4ddf-bbe5-bfb3da5878ba tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:55.499592 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd5b43bd-5ec0-4ddf-bbe5-bfb3da5878ba tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:55.500040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd5b43bd-5ec0-4ddf-bbe5-bfb3da5878ba tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:55.554559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:55.563834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:55.565300 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:55.566404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-720d101c-9c5f-4678-85b3-550fa84eb9c1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.155401 Aug 30 02:03:55.566954 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 531/1095] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:55 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:55.625199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cd5b43bd-5ec0-4ddf-bbe5-bfb3da5878ba tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:55.632557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cd5b43bd-5ec0-4ddf-bbe5-bfb3da5878ba tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.146930 Aug 30 02:03:55.633411 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 565/1096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:55 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:56.588452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:56.589092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:56.595566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:56.596051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:56.596515 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:56.597215 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:56.597664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:56.598109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:56.627251 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-49f561a5-9cd4-48f4-9378-391403761ce1 req-64f2d49a-abe0-4a7f-adac-eff75aa6c796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134294ec-5f9d-4bb0-9072-1a5d77761ad0", "tag": "2ea2bd06-9ec6-4e33-a531-8388db110df2"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:56.637862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-49f561a5-9cd4-48f4-9378-391403761ce1 req-64f2d49a-abe0-4a7f-adac-eff75aa6c796 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:56.638501 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-49f561a5-9cd4-48f4-9378-391403761ce1 req-64f2d49a-abe0-4a7f-adac-eff75aa6c796 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:56.639026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-49f561a5-9cd4-48f4-9378-391403761ce1 req-64f2d49a-abe0-4a7f-adac-eff75aa6c796 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:56.651754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-49f561a5-9cd4-48f4-9378-391403761ce1 req-64f2d49a-abe0-4a7f-adac-eff75aa6c796 service nova] Creating event network-changed:2ea2bd06-9ec6-4e33-a531-8388db110df2 for instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 on hv-cinder-81966 Aug 30 02:03:56.656923 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-49f561a5-9cd4-48f4-9378-391403761ce1 req-64f2d49a-abe0-4a7f-adac-eff75aa6c796 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034815 Aug 30 02:03:56.657626 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 566/1097] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:03:56.663835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f58781f0-ba86-491e-bc51-a2d5bb75acac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:56.665062 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f58781f0-ba86-491e-bc51-a2d5bb75acac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:56.671571 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f58781f0-ba86-491e-bc51-a2d5bb75acac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:56.672262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f58781f0-ba86-491e-bc51-a2d5bb75acac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:56.673672 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f58781f0-ba86-491e-bc51-a2d5bb75acac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:56.674778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f58781f0-ba86-491e-bc51-a2d5bb75acac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:56.675296 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f58781f0-ba86-491e-bc51-a2d5bb75acac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:56.675663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f58781f0-ba86-491e-bc51-a2d5bb75acac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:56.740584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:56.749584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:56.751029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:56.752137 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-06d0774e-7fd0-46c7-a082-3f9b2c524ae4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.167633 Aug 30 02:03:56.752725 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 532/1098] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:56 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:56.826340 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f58781f0-ba86-491e-bc51-a2d5bb75acac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:56.833767 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f58781f0-ba86-491e-bc51-a2d5bb75acac tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.174868 Aug 30 02:03:56.834320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 567/1099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:56 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:57.775487 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:57.776118 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:57.783086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:57.783519 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:57.784163 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:57.785140 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:57.785764 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:57.786191 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:57.855505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-60fff427-5473-48a4-ae0d-851a4e2f9289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:57.856123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-60fff427-5473-48a4-ae0d-851a4e2f9289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:57.859377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=4 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:57.864587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60fff427-5473-48a4-ae0d-851a4e2f9289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:57.864925 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60fff427-5473-48a4-ae0d-851a4e2f9289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:57.865493 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60fff427-5473-48a4-ae0d-851a4e2f9289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:57.866368 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60fff427-5473-48a4-ae0d-851a4e2f9289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:57.866824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60fff427-5473-48a4-ae0d-851a4e2f9289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:57.867253 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60fff427-5473-48a4-ae0d-851a4e2f9289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:57.928677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:57.937193 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:57.938639 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:57.939751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b98c660f-3180-4c2a-b9c1-5117634b7990 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.168455 Aug 30 02:03:57.940320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 533/1100] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:57 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:57.944636 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f0ca2027-79ca-44ce-b620-d005cd7820fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:57.945236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f0ca2027-79ca-44ce-b620-d005cd7820fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:57.951023 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0ca2027-79ca-44ce-b620-d005cd7820fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:57.951501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0ca2027-79ca-44ce-b620-d005cd7820fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:57.951928 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0ca2027-79ca-44ce-b620-d005cd7820fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:57.952644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0ca2027-79ca-44ce-b620-d005cd7820fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:57.953091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0ca2027-79ca-44ce-b620-d005cd7820fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:57.953509 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f0ca2027-79ca-44ce-b620-d005cd7820fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:58.017530 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-60fff427-5473-48a4-ae0d-851a4e2f9289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:58.025635 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-60fff427-5473-48a4-ae0d-851a4e2f9289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.174547 Aug 30 02:03:58.026123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 568/1101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:57 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:58.080679 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f0ca2027-79ca-44ce-b620-d005cd7820fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:58.089281 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f0ca2027-79ca-44ce-b620-d005cd7820fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1594 microversion: 2.1 time: 0.148036 Aug 30 02:03:58.089835 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 534/1102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:57 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1594 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:58.580973 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-e702f3a7-f82d-40a0-b1c9-4143eed4d31f req-456e4024-b89c-4f4e-9dfd-e834b4b3169b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2b4ac0-60fb-4e49-9da3-039bcfff7698", "name": "network-vif-plugged", "status": "completed", "tag": "b9d05127-de36-4e30-a898-feeb840846d0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:58.591475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-e702f3a7-f82d-40a0-b1c9-4143eed4d31f req-456e4024-b89c-4f4e-9dfd-e834b4b3169b service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:58.592064 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-e702f3a7-f82d-40a0-b1c9-4143eed4d31f req-456e4024-b89c-4f4e-9dfd-e834b4b3169b service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:58.592681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-e702f3a7-f82d-40a0-b1c9-4143eed4d31f req-456e4024-b89c-4f4e-9dfd-e834b4b3169b service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:58.604849 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-e702f3a7-f82d-40a0-b1c9-4143eed4d31f req-456e4024-b89c-4f4e-9dfd-e834b4b3169b service nova] Creating event network-vif-plugged:b9d05127-de36-4e30-a898-feeb840846d0 for instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 on hv-cinder-81966 Aug 30 02:03:58.610008 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-e702f3a7-f82d-40a0-b1c9-4143eed4d31f req-456e4024-b89c-4f4e-9dfd-e834b4b3169b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033231 Aug 30 02:03:58.610868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 569/1103] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:58.962350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:58.962947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:58.969808 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:58.970291 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:58.970778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:58.971473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:58.971926 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:58.972454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:59.047146 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b65080ce-6ded-41fa-a68b-d21d1ea88485 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:59.047875 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b65080ce-6ded-41fa-a68b-d21d1ea88485 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:59.053934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b65080ce-6ded-41fa-a68b-d21d1ea88485 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:59.054420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b65080ce-6ded-41fa-a68b-d21d1ea88485 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:59.054870 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b65080ce-6ded-41fa-a68b-d21d1ea88485 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:59.055557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b65080ce-6ded-41fa-a68b-d21d1ea88485 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:59.056009 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b65080ce-6ded-41fa-a68b-d21d1ea88485 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:59.056461 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b65080ce-6ded-41fa-a68b-d21d1ea88485 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:59.155244 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:59.163706 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:59.165356 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:59.166827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e298b729-198a-4bd2-acb8-bda944a2c465 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.208410 Aug 30 02:03:59.167501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 535/1104] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:03:58 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:03:59.197434 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b65080ce-6ded-41fa-a68b-d21d1ea88485 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:59.205255 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b65080ce-6ded-41fa-a68b-d21d1ea88485 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.162914 Aug 30 02:03:59.206119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 570/1105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:59 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:59.825632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-ba3810ae-8de9-4ba1-b5bb-6d1453329293 req-00dfeab1-bed0-44a5-9764-100ddbabe16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ed5413-5513-4b3f-8588-34ba725fff26", "tag": "368b4b69-ee2c-423b-823b-2d0eae43ecae"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:59.830787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:59.831723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=10 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:59.838576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ba3810ae-8de9-4ba1-b5bb-6d1453329293 req-00dfeab1-bed0-44a5-9764-100ddbabe16e service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:59.838576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ba3810ae-8de9-4ba1-b5bb-6d1453329293 req-00dfeab1-bed0-44a5-9764-100ddbabe16e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:59.838576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-ba3810ae-8de9-4ba1-b5bb-6d1453329293 req-00dfeab1-bed0-44a5-9764-100ddbabe16e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:59.850447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-ba3810ae-8de9-4ba1-b5bb-6d1453329293 req-00dfeab1-bed0-44a5-9764-100ddbabe16e service nova] Creating event network-changed:368b4b69-ee2c-423b-823b-2d0eae43ecae for instance b0ed5413-5513-4b3f-8588-34ba725fff26 on hv-cinder-81966 Aug 30 02:03:59.856152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-ba3810ae-8de9-4ba1-b5bb-6d1453329293 req-00dfeab1-bed0-44a5-9764-100ddbabe16e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034276 Aug 30 02:03:59.859945 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 536/1106] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:00.186690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=14 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:00.191994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:00.192875 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:00.200638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:00.201233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:00.201873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:00.205423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:00.205423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:00.205423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:00.231651 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-651a252a-352d-4af2-8ac7-6c441e3ad37d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:00.232467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-651a252a-352d-4af2-8ac7-6c441e3ad37d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:00.245746 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-651a252a-352d-4af2-8ac7-6c441e3ad37d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:00.246287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-651a252a-352d-4af2-8ac7-6c441e3ad37d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:00.246809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-651a252a-352d-4af2-8ac7-6c441e3ad37d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:00.247905 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-651a252a-352d-4af2-8ac7-6c441e3ad37d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:00.248800 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-651a252a-352d-4af2-8ac7-6c441e3ad37d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:00.249486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-651a252a-352d-4af2-8ac7-6c441e3ad37d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:00.375036 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:00.384103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:00.387888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:00.389102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6d2affe6-7b59-49da-9492-b179241c805b tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.203323 Aug 30 02:04:00.390164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 571/1107] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:04:00 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:04:00.437090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-651a252a-352d-4af2-8ac7-6c441e3ad37d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:00.447185 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-651a252a-352d-4af2-8ac7-6c441e3ad37d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.224019 Aug 30 02:04:00.448107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 537/1108] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:00 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:00.817648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0999f336-5b3a-46b8-ad79-c875553e32bc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1330017264"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:00.818267 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0999f336-5b3a-46b8-ad79-c875553e32bc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:00.834874 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0999f336-5b3a-46b8-ad79-c875553e32bc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:00.835429 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0999f336-5b3a-46b8-ad79-c875553e32bc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:00.836012 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0999f336-5b3a-46b8-ad79-c875553e32bc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:00.837472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0999f336-5b3a-46b8-ad79-c875553e32bc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:00.837923 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0999f336-5b3a-46b8-ad79-c875553e32bc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:00.838347 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0999f336-5b3a-46b8-ad79-c875553e32bc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:01.018822 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.network.security_group_api [None req-0999f336-5b3a-46b8-ad79-c875553e32bc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Adding security group 0ffb3dc9-f939-41e9-bbe4-57c9aea3b9b6 to port 368b4b69-ee2c-423b-823b-2d0eae43ecae Aug 30 02:04:01.412592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:01.413186 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:01.419237 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:01.419718 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:01.420143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:01.420861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:01.421304 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:01.421719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:01.528980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0999f336-5b3a-46b8-ad79-c875553e32bc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "POST /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/action" status: 202 len: 0 microversion: 2.1 time: 0.715399 Aug 30 02:04:01.530109 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 572/1109] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:04:00 2022] POST /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:04:01.534807 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-787cdb19-631a-42aa-aa5e-9bcc80ee12de tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:01.535602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-787cdb19-631a-42aa-aa5e-9bcc80ee12de tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:01.542229 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-787cdb19-631a-42aa-aa5e-9bcc80ee12de tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:01.542800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-787cdb19-631a-42aa-aa5e-9bcc80ee12de tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:01.543292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-787cdb19-631a-42aa-aa5e-9bcc80ee12de tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:01.544221 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-787cdb19-631a-42aa-aa5e-9bcc80ee12de tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:01.544767 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-787cdb19-631a-42aa-aa5e-9bcc80ee12de tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:01.545278 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-787cdb19-631a-42aa-aa5e-9bcc80ee12de tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:01.561555 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:01.573017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:01.575719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:01.577159 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6b0a04a1-03c5-4f37-9b53-cf749ec5bdc1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.168607 Aug 30 02:04:01.584467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 538/1110] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:04:01 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:04:01.590459 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f1471574-2b73-4381-b04f-e0848b5c705d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:01.591091 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f1471574-2b73-4381-b04f-e0848b5c705d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:01.600894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1471574-2b73-4381-b04f-e0848b5c705d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:01.601388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1471574-2b73-4381-b04f-e0848b5c705d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:01.601909 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1471574-2b73-4381-b04f-e0848b5c705d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:01.602641 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1471574-2b73-4381-b04f-e0848b5c705d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:01.603095 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1471574-2b73-4381-b04f-e0848b5c705d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:01.603518 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f1471574-2b73-4381-b04f-e0848b5c705d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:01.695169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-787cdb19-631a-42aa-aa5e-9bcc80ee12de tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:01.703788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-787cdb19-631a-42aa-aa5e-9bcc80ee12de tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.172647 Aug 30 02:04:01.704358 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 573/1111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:01 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:01.708759 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-8146c802-cebe-4f61-8fdc-e28da13e8ac3 req-6e2e6f29-2888-4047-8570-1d0544ca091e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ed5413-5513-4b3f-8588-34ba725fff26", "tag": "368b4b69-ee2c-423b-823b-2d0eae43ecae"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:01.717994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-8146c802-cebe-4f61-8fdc-e28da13e8ac3 req-6e2e6f29-2888-4047-8570-1d0544ca091e service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:01.718469 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-8146c802-cebe-4f61-8fdc-e28da13e8ac3 req-6e2e6f29-2888-4047-8570-1d0544ca091e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:01.719396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-8146c802-cebe-4f61-8fdc-e28da13e8ac3 req-6e2e6f29-2888-4047-8570-1d0544ca091e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:01.730026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-8146c802-cebe-4f61-8fdc-e28da13e8ac3 req-6e2e6f29-2888-4047-8570-1d0544ca091e service nova] Creating event network-changed:368b4b69-ee2c-423b-823b-2d0eae43ecae for instance b0ed5413-5513-4b3f-8588-34ba725fff26 on hv-cinder-81966 Aug 30 02:04:01.734747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-8146c802-cebe-4f61-8fdc-e28da13e8ac3 req-6e2e6f29-2888-4047-8570-1d0544ca091e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029254 Aug 30 02:04:01.735529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 574/1112] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:01.754559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f1471574-2b73-4381-b04f-e0848b5c705d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:01.764295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f1471574-2b73-4381-b04f-e0848b5c705d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1641 microversion: 2.1 time: 0.178767 Aug 30 02:04:01.764943 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 539/1113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:01 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1641 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:02.602843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:02.604125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:02.610208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:02.610694 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:02.611123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:02.612004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:02.612482 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:02.613154 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:02.723707 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-401d6f1d-9045-463b-80c5-424714d69da5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:02.725041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-401d6f1d-9045-463b-80c5-424714d69da5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:02.732494 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-401d6f1d-9045-463b-80c5-424714d69da5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:02.733059 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-401d6f1d-9045-463b-80c5-424714d69da5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:02.733715 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-401d6f1d-9045-463b-80c5-424714d69da5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:02.734613 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-401d6f1d-9045-463b-80c5-424714d69da5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:02.735249 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-401d6f1d-9045-463b-80c5-424714d69da5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:02.736101 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-401d6f1d-9045-463b-80c5-424714d69da5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:02.844693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:02.864696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:02.866125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:02.868555 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3269d86a-c671-45c9-adc3-4451bf9d6e9f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1407 microversion: 2.20 time: 0.269289 Aug 30 02:04:02.869706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 575/1114] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:04:02 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:04:02.878409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-401d6f1d-9045-463b-80c5-424714d69da5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:02.887320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-401d6f1d-9045-463b-80c5-424714d69da5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.167513 Aug 30 02:04:02.887882 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 540/1115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:02 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:03.892111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:03.892723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:03.899930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:03.900131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:03.900470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:03.901157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:03.901605 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:03.902291 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:03.910257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-950958a7-792a-40aa-8aba-3a0d6045719f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:03.910866 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-950958a7-792a-40aa-8aba-3a0d6045719f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:03.917819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-950958a7-792a-40aa-8aba-3a0d6045719f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:03.918302 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-950958a7-792a-40aa-8aba-3a0d6045719f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:03.918730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-950958a7-792a-40aa-8aba-3a0d6045719f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:03.919589 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-950958a7-792a-40aa-8aba-3a0d6045719f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:03.920037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-950958a7-792a-40aa-8aba-3a0d6045719f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:03.920487 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-950958a7-792a-40aa-8aba-3a0d6045719f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:04.049470 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-950958a7-792a-40aa-8aba-3a0d6045719f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:04.057242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-950958a7-792a-40aa-8aba-3a0d6045719f tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.151519 Aug 30 02:04:04.057809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 541/1116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:03 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:04.108678 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:04.110968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:04.118643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:04.120071 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:04.121240 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5aa6e68a-ff0b-444b-86f9-86a3d6270279 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1600 microversion: 2.20 time: 0.233083 Aug 30 02:04:04.121789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 576/1117] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:04:03 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1600 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:04:04.143314 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dab8b27d-3390-48ff-a469-d08cdde24373 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:04.143728 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dab8b27d-3390-48ff-a469-d08cdde24373 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:04.150476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dab8b27d-3390-48ff-a469-d08cdde24373 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:04.150958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dab8b27d-3390-48ff-a469-d08cdde24373 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:04.151648 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dab8b27d-3390-48ff-a469-d08cdde24373 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:04.152360 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dab8b27d-3390-48ff-a469-d08cdde24373 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:04.152807 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dab8b27d-3390-48ff-a469-d08cdde24373 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:04.153225 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dab8b27d-3390-48ff-a469-d08cdde24373 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:04.230712 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dab8b27d-3390-48ff-a469-d08cdde24373 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091222 Aug 30 02:04:04.231455 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 542/1118] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 30 02:04:04 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:04:04.991109 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-4affc56d-32e8-4754-924d-1e9e434528d0 req-5ec8612c-1029-469e-a168-e6ac9fd22bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134294ec-5f9d-4bb0-9072-1a5d77761ad0", "name": "network-vif-plugged", "status": "completed", "tag": "2ea2bd06-9ec6-4e33-a531-8388db110df2"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:05.007182 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-4affc56d-32e8-4754-924d-1e9e434528d0 req-5ec8612c-1029-469e-a168-e6ac9fd22bf3 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:05.007763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-4affc56d-32e8-4754-924d-1e9e434528d0 req-5ec8612c-1029-469e-a168-e6ac9fd22bf3 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:05.009726 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-4affc56d-32e8-4754-924d-1e9e434528d0 req-5ec8612c-1029-469e-a168-e6ac9fd22bf3 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:05.027330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-4affc56d-32e8-4754-924d-1e9e434528d0 req-5ec8612c-1029-469e-a168-e6ac9fd22bf3 service nova] Creating event network-vif-plugged:2ea2bd06-9ec6-4e33-a531-8388db110df2 for instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 on hv-cinder-81966 Aug 30 02:04:05.032834 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-4affc56d-32e8-4754-924d-1e9e434528d0 req-5ec8612c-1029-469e-a168-e6ac9fd22bf3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047599 Aug 30 02:04:05.033843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 577/1119] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:05.078402 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-49704bec-dfa0-4b79-a962-6657e5bde25e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:05.078950 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-49704bec-dfa0-4b79-a962-6657e5bde25e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:05.085187 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-49704bec-dfa0-4b79-a962-6657e5bde25e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:05.085694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-49704bec-dfa0-4b79-a962-6657e5bde25e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:05.086143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-49704bec-dfa0-4b79-a962-6657e5bde25e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:05.087494 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-49704bec-dfa0-4b79-a962-6657e5bde25e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:05.087949 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-49704bec-dfa0-4b79-a962-6657e5bde25e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:05.088407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-49704bec-dfa0-4b79-a962-6657e5bde25e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:05.225424 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-49704bec-dfa0-4b79-a962-6657e5bde25e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:05.233542 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-49704bec-dfa0-4b79-a962-6657e5bde25e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.159583 Aug 30 02:04:05.234103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 543/1120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:05 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:05.634515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-f7b1c1e6-d599-43a7-8e31-742e961c8d98 req-7cac8e5a-905c-43d4-a6ad-0f18b41cd88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df2b4ac0-60fb-4e49-9da3-039bcfff7698", "tag": "b9d05127-de36-4e30-a898-feeb840846d0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:05.643756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-f7b1c1e6-d599-43a7-8e31-742e961c8d98 req-7cac8e5a-905c-43d4-a6ad-0f18b41cd88f service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:05.644256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-f7b1c1e6-d599-43a7-8e31-742e961c8d98 req-7cac8e5a-905c-43d4-a6ad-0f18b41cd88f service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:05.644712 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-f7b1c1e6-d599-43a7-8e31-742e961c8d98 req-7cac8e5a-905c-43d4-a6ad-0f18b41cd88f service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:05.655121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-f7b1c1e6-d599-43a7-8e31-742e961c8d98 req-7cac8e5a-905c-43d4-a6ad-0f18b41cd88f service nova] Creating event network-changed:b9d05127-de36-4e30-a898-feeb840846d0 for instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 on hv-cinder-81966 Aug 30 02:04:05.659934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-f7b1c1e6-d599-43a7-8e31-742e961c8d98 req-7cac8e5a-905c-43d4-a6ad-0f18b41cd88f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030213 Aug 30 02:04:05.660576 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 578/1121] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:06.253655 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-dc722606-5ac8-4fc4-adac-ceceb50073a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:06.254262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-dc722606-5ac8-4fc4-adac-ceceb50073a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:06.260947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc722606-5ac8-4fc4-adac-ceceb50073a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:06.261433 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc722606-5ac8-4fc4-adac-ceceb50073a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:06.261871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc722606-5ac8-4fc4-adac-ceceb50073a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:06.262561 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc722606-5ac8-4fc4-adac-ceceb50073a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:06.263013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc722606-5ac8-4fc4-adac-ceceb50073a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:06.263438 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-dc722606-5ac8-4fc4-adac-ceceb50073a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:06.393046 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-dc722606-5ac8-4fc4-adac-ceceb50073a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:06.401640 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-dc722606-5ac8-4fc4-adac-ceceb50073a2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.151858 Aug 30 02:04:06.402208 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 544/1122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:06 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:07.423351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c78bee95-666f-4d69-828f-55fc9a1a863b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:07.424072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c78bee95-666f-4d69-828f-55fc9a1a863b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:07.430745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c78bee95-666f-4d69-828f-55fc9a1a863b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:07.431227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c78bee95-666f-4d69-828f-55fc9a1a863b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:07.431662 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c78bee95-666f-4d69-828f-55fc9a1a863b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:07.432391 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c78bee95-666f-4d69-828f-55fc9a1a863b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:07.432847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c78bee95-666f-4d69-828f-55fc9a1a863b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:07.433274 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c78bee95-666f-4d69-828f-55fc9a1a863b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:07.558745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c78bee95-666f-4d69-828f-55fc9a1a863b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:07.566193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c78bee95-666f-4d69-828f-55fc9a1a863b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1367 microversion: 2.1 time: 0.147603 Aug 30 02:04:07.566752 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 579/1123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:07 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:08.586465 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c60a3d95-4f15-4e87-9b07-5af72dc6b712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:08.587075 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c60a3d95-4f15-4e87-9b07-5af72dc6b712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:08.593320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c60a3d95-4f15-4e87-9b07-5af72dc6b712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:08.593798 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c60a3d95-4f15-4e87-9b07-5af72dc6b712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:08.594233 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c60a3d95-4f15-4e87-9b07-5af72dc6b712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:08.594916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c60a3d95-4f15-4e87-9b07-5af72dc6b712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:08.595369 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c60a3d95-4f15-4e87-9b07-5af72dc6b712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:08.595797 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c60a3d95-4f15-4e87-9b07-5af72dc6b712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:08.724697 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c60a3d95-4f15-4e87-9b07-5af72dc6b712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:08.732662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c60a3d95-4f15-4e87-9b07-5af72dc6b712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1556 microversion: 2.1 time: 0.150069 Aug 30 02:04:08.733216 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 545/1124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:08 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:08.752911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8013c56b-b5a3-4496-88fd-88b0d7fbbc66 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:08.753386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8013c56b-b5a3-4496-88fd-88b0d7fbbc66 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:08.760338 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8013c56b-b5a3-4496-88fd-88b0d7fbbc66 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:08.760828 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8013c56b-b5a3-4496-88fd-88b0d7fbbc66 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:08.761265 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8013c56b-b5a3-4496-88fd-88b0d7fbbc66 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:08.761986 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8013c56b-b5a3-4496-88fd-88b0d7fbbc66 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:08.762493 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8013c56b-b5a3-4496-88fd-88b0d7fbbc66 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:08.762916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8013c56b-b5a3-4496-88fd-88b0d7fbbc66 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:08.841418 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8013c56b-b5a3-4496-88fd-88b0d7fbbc66 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092326 Aug 30 02:04:08.842080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 580/1125] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 02:04:08 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:09.739790 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-5a9bb66f-70ac-4e89-bc5d-49f8684f98ae req-f7a2ffdc-2020-412e-ad29-5652af7bb1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134294ec-5f9d-4bb0-9072-1a5d77761ad0", "tag": "2ea2bd06-9ec6-4e33-a531-8388db110df2"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:09.749555 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5a9bb66f-70ac-4e89-bc5d-49f8684f98ae req-f7a2ffdc-2020-412e-ad29-5652af7bb1a1 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:09.750027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5a9bb66f-70ac-4e89-bc5d-49f8684f98ae req-f7a2ffdc-2020-412e-ad29-5652af7bb1a1 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:09.750452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5a9bb66f-70ac-4e89-bc5d-49f8684f98ae req-f7a2ffdc-2020-412e-ad29-5652af7bb1a1 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:09.761856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-5a9bb66f-70ac-4e89-bc5d-49f8684f98ae req-f7a2ffdc-2020-412e-ad29-5652af7bb1a1 service nova] Creating event network-changed:2ea2bd06-9ec6-4e33-a531-8388db110df2 for instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 on hv-cinder-81966 Aug 30 02:04:09.766939 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-5a9bb66f-70ac-4e89-bc5d-49f8684f98ae req-f7a2ffdc-2020-412e-ad29-5652af7bb1a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030696 Aug 30 02:04:09.767520 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 546/1126] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:28.463534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:28.464329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=15 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:28.468522 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-41ef572d-ff8e-4024-89fd-746a637cdfbd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:28.469042 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-41ef572d-ff8e-4024-89fd-746a637cdfbd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:28.476218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41ef572d-ff8e-4024-89fd-746a637cdfbd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:28.476725 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41ef572d-ff8e-4024-89fd-746a637cdfbd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:28.477648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41ef572d-ff8e-4024-89fd-746a637cdfbd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:28.478337 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41ef572d-ff8e-4024-89fd-746a637cdfbd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:28.478823 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41ef572d-ff8e-4024-89fd-746a637cdfbd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:28.479250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41ef572d-ff8e-4024-89fd-746a637cdfbd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:28.558685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-41ef572d-ff8e-4024-89fd-746a637cdfbd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lazy-loading 'services' on Instance uuid 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:04:28.635267 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-41ef572d-ff8e-4024-89fd-746a637cdfbd tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments/d88ed96e-b9a8-446e-9eab-99fddc1ddb5b" status: 202 len: 0 microversion: 2.1 time: 0.173044 Aug 30 02:04:28.635853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 581/1127] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:04:28 2022] DELETE /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments/d88ed96e-b9a8-446e-9eab-99fddc1ddb5b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:04:28.646308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2b7ca950-aaca-427a-99c4-bae21c0b1942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:28.648572 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2b7ca950-aaca-427a-99c4-bae21c0b1942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:28.651283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=35 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:28.651962 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=82 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:28.659677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b7ca950-aaca-427a-99c4-bae21c0b1942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:28.660190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b7ca950-aaca-427a-99c4-bae21c0b1942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:28.660670 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b7ca950-aaca-427a-99c4-bae21c0b1942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:28.661356 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b7ca950-aaca-427a-99c4-bae21c0b1942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:28.661804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b7ca950-aaca-427a-99c4-bae21c0b1942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:28.662223 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2b7ca950-aaca-427a-99c4-bae21c0b1942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:28.693868 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2b7ca950-aaca-427a-99c4-bae21c0b1942 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053004 Aug 30 02:04:28.694425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 547/1128] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:04:28 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:29.707165 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4aea9a18-14a6-488a-8e4a-e88ed5c33a78 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:29.709383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4aea9a18-14a6-488a-8e4a-e88ed5c33a78 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:29.715487 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aea9a18-14a6-488a-8e4a-e88ed5c33a78 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:29.715970 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aea9a18-14a6-488a-8e4a-e88ed5c33a78 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:29.716446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aea9a18-14a6-488a-8e4a-e88ed5c33a78 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:29.717136 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aea9a18-14a6-488a-8e4a-e88ed5c33a78 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:29.717587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aea9a18-14a6-488a-8e4a-e88ed5c33a78 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:29.718009 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4aea9a18-14a6-488a-8e4a-e88ed5c33a78 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:29.749032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4aea9a18-14a6-488a-8e4a-e88ed5c33a78 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046677 Aug 30 02:04:29.749573 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 582/1129] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:04:29 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:30.762006 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-be56a809-d439-4fc1-bf0b-48c0bf187a40 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:30.764163 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-be56a809-d439-4fc1-bf0b-48c0bf187a40 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:30.770945 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be56a809-d439-4fc1-bf0b-48c0bf187a40 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:30.771428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be56a809-d439-4fc1-bf0b-48c0bf187a40 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:30.771865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be56a809-d439-4fc1-bf0b-48c0bf187a40 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:30.772591 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be56a809-d439-4fc1-bf0b-48c0bf187a40 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:30.773048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be56a809-d439-4fc1-bf0b-48c0bf187a40 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:30.773471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-be56a809-d439-4fc1-bf0b-48c0bf187a40 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:30.801945 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-be56a809-d439-4fc1-bf0b-48c0bf187a40 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044672 Aug 30 02:04:30.802483 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 548/1130] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:04:30 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:04:30.882242 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a4c584b1-3283-4294-9117-ebb6767231a9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:30.882931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a4c584b1-3283-4294-9117-ebb6767231a9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:30.890085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4c584b1-3283-4294-9117-ebb6767231a9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:30.890568 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4c584b1-3283-4294-9117-ebb6767231a9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:30.891006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4c584b1-3283-4294-9117-ebb6767231a9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:30.891695 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4c584b1-3283-4294-9117-ebb6767231a9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:30.892147 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4c584b1-3283-4294-9117-ebb6767231a9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:30.892601 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4c584b1-3283-4294-9117-ebb6767231a9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:30.916910 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a4c584b1-3283-4294-9117-ebb6767231a9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Going to try to terminate instance {{(pid=120391) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:04:30.991049 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a4c584b1-3283-4294-9117-ebb6767231a9 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 204 len: 0 microversion: 2.1 time: 0.112383 Aug 30 02:04:30.991735 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 583/1131] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:04:30 2022] DELETE /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:04:31.000837 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-54a7c77a-c614-49e2-966e-5af145a1909a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:31.001447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-54a7c77a-c614-49e2-966e-5af145a1909a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:31.007404 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54a7c77a-c614-49e2-966e-5af145a1909a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:31.007886 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54a7c77a-c614-49e2-966e-5af145a1909a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:31.008345 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54a7c77a-c614-49e2-966e-5af145a1909a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:31.009291 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54a7c77a-c614-49e2-966e-5af145a1909a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:31.010437 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54a7c77a-c614-49e2-966e-5af145a1909a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:31.010864 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-54a7c77a-c614-49e2-966e-5af145a1909a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:31.140998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-54a7c77a-c614-49e2-966e-5af145a1909a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:31.148504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-54a7c77a-c614-49e2-966e-5af145a1909a tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1689 microversion: 2.1 time: 0.151641 Aug 30 02:04:31.149054 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 549/1132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:30 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:32.170026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4e82cca2-39e0-494f-b21f-5e6295fd1f71 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:32.170742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4e82cca2-39e0-494f-b21f-5e6295fd1f71 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:32.177000 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e82cca2-39e0-494f-b21f-5e6295fd1f71 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:32.177475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e82cca2-39e0-494f-b21f-5e6295fd1f71 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:32.177901 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e82cca2-39e0-494f-b21f-5e6295fd1f71 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:32.178579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e82cca2-39e0-494f-b21f-5e6295fd1f71 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:32.179026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e82cca2-39e0-494f-b21f-5e6295fd1f71 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:32.179443 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4e82cca2-39e0-494f-b21f-5e6295fd1f71 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:32.311488 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4e82cca2-39e0-494f-b21f-5e6295fd1f71 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:32.319194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4e82cca2-39e0-494f-b21f-5e6295fd1f71 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1689 microversion: 2.1 time: 0.153568 Aug 30 02:04:32.319817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 584/1133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:32 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:33.340550 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b8a7bd42-1012-40de-a668-7c8a95f93070 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:33.341165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b8a7bd42-1012-40de-a668-7c8a95f93070 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:33.347516 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b8a7bd42-1012-40de-a668-7c8a95f93070 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:33.347998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b8a7bd42-1012-40de-a668-7c8a95f93070 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:33.348478 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b8a7bd42-1012-40de-a668-7c8a95f93070 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:33.349163 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b8a7bd42-1012-40de-a668-7c8a95f93070 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:33.349615 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b8a7bd42-1012-40de-a668-7c8a95f93070 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:33.350037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b8a7bd42-1012-40de-a668-7c8a95f93070 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:33.476674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b8a7bd42-1012-40de-a668-7c8a95f93070 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:33.484194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b8a7bd42-1012-40de-a668-7c8a95f93070 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1689 microversion: 2.1 time: 0.148177 Aug 30 02:04:33.484785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 550/1134] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:33 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:34.505350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2900d5f7-bf33-42aa-a122-a8f750379782 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:34.505961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2900d5f7-bf33-42aa-a122-a8f750379782 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:34.512920 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2900d5f7-bf33-42aa-a122-a8f750379782 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:34.513400 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2900d5f7-bf33-42aa-a122-a8f750379782 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:34.513833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2900d5f7-bf33-42aa-a122-a8f750379782 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:34.514516 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2900d5f7-bf33-42aa-a122-a8f750379782 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:34.514965 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2900d5f7-bf33-42aa-a122-a8f750379782 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:34.515390 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2900d5f7-bf33-42aa-a122-a8f750379782 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:34.640579 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2900d5f7-bf33-42aa-a122-a8f750379782 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:34.648152 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2900d5f7-bf33-42aa-a122-a8f750379782 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1689 microversion: 2.1 time: 0.146671 Aug 30 02:04:34.648737 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 585/1135] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:34 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:35.670311 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3ff71b81-e7e7-450c-ba61-e83f1d89f9ca tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:35.671435 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3ff71b81-e7e7-450c-ba61-e83f1d89f9ca tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:35.677659 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ff71b81-e7e7-450c-ba61-e83f1d89f9ca tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:35.678161 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ff71b81-e7e7-450c-ba61-e83f1d89f9ca tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:35.678603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ff71b81-e7e7-450c-ba61-e83f1d89f9ca tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:35.679945 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ff71b81-e7e7-450c-ba61-e83f1d89f9ca tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:35.680441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ff71b81-e7e7-450c-ba61-e83f1d89f9ca tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:35.680873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3ff71b81-e7e7-450c-ba61-e83f1d89f9ca tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:35.750168 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3ff71b81-e7e7-450c-ba61-e83f1d89f9ca tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:35.760142 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3ff71b81-e7e7-450c-ba61-e83f1d89f9ca tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1623 microversion: 2.1 time: 0.093864 Aug 30 02:04:35.760797 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 551/1136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:35 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1623 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:35.936353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-22812138-3fbb-4b6c-bf54-59a693296e6e req-544ba0e6-3205-434c-b1d5-ff84f6db78cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9adad9-3583-4b2c-bb23-b55ab2c97b2c", "name": "network-vif-deleted", "tag": "23743ca1-3a9e-4a05-9026-c437ca9a2dec"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:35.947366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-22812138-3fbb-4b6c-bf54-59a693296e6e req-544ba0e6-3205-434c-b1d5-ff84f6db78cd service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:35.947831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-22812138-3fbb-4b6c-bf54-59a693296e6e req-544ba0e6-3205-434c-b1d5-ff84f6db78cd service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:35.948283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-22812138-3fbb-4b6c-bf54-59a693296e6e req-544ba0e6-3205-434c-b1d5-ff84f6db78cd service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:35.960003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-22812138-3fbb-4b6c-bf54-59a693296e6e req-544ba0e6-3205-434c-b1d5-ff84f6db78cd service nova] Creating event network-vif-deleted:23743ca1-3a9e-4a05-9026-c437ca9a2dec for instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c on hv-cinder-81966 Aug 30 02:04:35.965692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-22812138-3fbb-4b6c-bf54-59a693296e6e req-544ba0e6-3205-434c-b1d5-ff84f6db78cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033319 Aug 30 02:04:35.966714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 586/1137] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:36.781358 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:36.781972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:36.789094 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:36.789581 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:36.790018 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:36.791371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:36.791918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:36.792374 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:36.826108 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:36.826586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:36.827017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:36.827457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lazy-loading 'fault' on Instance uuid 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:04:36.874751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:36.884869 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d50bff1d-f394-4b56-a772-afd3b7b16f14 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 200 len: 1335 microversion: 2.1 time: 0.106256 Aug 30 02:04:36.885452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 552/1138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:36 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:37.906827 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:37.907528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:37.913612 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:37.914098 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:37.914532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:37.916375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:37.916375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:37.920481 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:37.929790 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] HTTP exception thrown: Instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c could not be found. Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Request method failure captured: Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c HTTP/1.1 Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW6CH7rafVDf4Z49atCLViZ3JqK9FndKwadpATmAmjejXk-UMRbD6IDWbAEx9isb3LOGqCn3HFUiYljZOMTtY27lIE59l05A16SAbSpwxTuNaNf8VE8NsWO8DEt-mYiMRkVjGpfCnCmkLjQIxdO90EaVSI7HOs-2sZqlS7yDVykN_Iw Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 688f10cbc5ce42b895bb7a9285749cca Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:04:37.932082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_688f10cbc5ce42b895bb7a9285749cca"}]}] Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 688f10cbc5ce42b895bb7a9285749cca Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-ServerRescueNegativeTestJSON-108033553-project Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 86f364f03c7d4360b4a75ed194846ade Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-ServerRescueNegativeTestJSON-108033553-project Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c could not be found. Aug 30 02:04:37.934598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '5a9adad9-3583-4b2c-bb23-b55ab2c97b2c'} Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c could not be found. Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:04:37.936041 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c could not be found. Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c could not be found. Aug 30 02:04:37.939250 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:04:37.942275 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Returning 404 to user: Instance 5a9adad9-3583-4b2c-bb23-b55ab2c97b2c could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:04:37.942275 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f8008075-943b-41a7-9f6e-b330a8448e76 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c" status: 404 len: 111 microversion: 2.1 time: 0.031354 Aug 30 02:04:37.942275 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 587/1139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:37 2022] GET /compute/v2.1/servers/5a9adad9-3583-4b2c-bb23-b55ab2c97b2c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:04:37.945061 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3704af88-8984-4bbe-ad7c-6875be90f2f8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '.version_select at 0x7f3b083fc670>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:37.963583 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3704af88-8984-4bbe-ad7c-6875be90f2f8 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-682494787" status: 202 len: 0 microversion: 2.1 time: 0.024643 Aug 30 02:04:37.964134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 553/1140] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 02:04:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-682494787 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:04:40.800512 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4247cdd4-aaf3-4306-b437-233742af7673 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:40.801003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4247cdd4-aaf3-4306-b437-233742af7673 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:40.808057 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4247cdd4-aaf3-4306-b437-233742af7673 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:40.808562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4247cdd4-aaf3-4306-b437-233742af7673 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:40.808992 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4247cdd4-aaf3-4306-b437-233742af7673 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:40.809664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4247cdd4-aaf3-4306-b437-233742af7673 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:40.810105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4247cdd4-aaf3-4306-b437-233742af7673 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:40.810522 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4247cdd4-aaf3-4306-b437-233742af7673 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:40.834598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4247cdd4-aaf3-4306-b437-233742af7673 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Going to try to terminate instance {{(pid=120391) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:04:40.926423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4247cdd4-aaf3-4306-b437-233742af7673 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 204 len: 0 microversion: 2.1 time: 0.129318 Aug 30 02:04:40.927020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 588/1141] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:04:40 2022] DELETE /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:04:40.936123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b7ef8d86-34d3-4f20-bcd3-f869577748b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:40.936765 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b7ef8d86-34d3-4f20-bcd3-f869577748b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:40.946786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7ef8d86-34d3-4f20-bcd3-f869577748b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:40.947264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7ef8d86-34d3-4f20-bcd3-f869577748b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:40.947714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7ef8d86-34d3-4f20-bcd3-f869577748b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:40.948469 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7ef8d86-34d3-4f20-bcd3-f869577748b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:40.948958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7ef8d86-34d3-4f20-bcd3-f869577748b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:40.949379 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7ef8d86-34d3-4f20-bcd3-f869577748b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:41.073918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-b7ef8d86-34d3-4f20-bcd3-f869577748b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:41.081451 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b7ef8d86-34d3-4f20-bcd3-f869577748b5 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1508 microversion: 2.1 time: 0.150086 Aug 30 02:04:41.082003 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 554/1142] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:40 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:42.104008 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6dae8cc5-1e5f-4d4e-90d0-c4a2d9747952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:42.104722 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6dae8cc5-1e5f-4d4e-90d0-c4a2d9747952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:42.110914 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dae8cc5-1e5f-4d4e-90d0-c4a2d9747952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:42.111385 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dae8cc5-1e5f-4d4e-90d0-c4a2d9747952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:42.111810 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dae8cc5-1e5f-4d4e-90d0-c4a2d9747952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:42.112519 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dae8cc5-1e5f-4d4e-90d0-c4a2d9747952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:42.112967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dae8cc5-1e5f-4d4e-90d0-c4a2d9747952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:42.113380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6dae8cc5-1e5f-4d4e-90d0-c4a2d9747952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:42.338038 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6dae8cc5-1e5f-4d4e-90d0-c4a2d9747952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:42.345569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6dae8cc5-1e5f-4d4e-90d0-c4a2d9747952 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1508 microversion: 2.1 time: 0.246355 Aug 30 02:04:42.346121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 589/1143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:42 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:42.595692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-3f75473a-cc5c-4142-9263-a4670c359e25 req-f5ad5cf2-b9b1-48fb-9fed-beb1865c6132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4545ddca-1552-48ca-96fe-f8a605e82b1b", "name": "network-vif-deleted", "tag": "12232d57-49a7-4e71-b0d3-4e6a819228a8"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:42.605733 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3f75473a-cc5c-4142-9263-a4670c359e25 req-f5ad5cf2-b9b1-48fb-9fed-beb1865c6132 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:42.606303 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3f75473a-cc5c-4142-9263-a4670c359e25 req-f5ad5cf2-b9b1-48fb-9fed-beb1865c6132 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:42.606809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-3f75473a-cc5c-4142-9263-a4670c359e25 req-f5ad5cf2-b9b1-48fb-9fed-beb1865c6132 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:42.618141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-3f75473a-cc5c-4142-9263-a4670c359e25 req-f5ad5cf2-b9b1-48fb-9fed-beb1865c6132 service nova] Creating event network-vif-deleted:12232d57-49a7-4e71-b0d3-4e6a819228a8 for instance 4545ddca-1552-48ca-96fe-f8a605e82b1b on hv-cinder-81966 Aug 30 02:04:42.623910 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-3f75473a-cc5c-4142-9263-a4670c359e25 req-f5ad5cf2-b9b1-48fb-9fed-beb1865c6132 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032099 Aug 30 02:04:42.624817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 555/1144] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:43.367310 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:43.367914 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:43.374648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:43.375130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:43.375558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:43.376282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:43.376756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:43.377175 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:43.408117 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:43.408631 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:43.409170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:43.409499 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lazy-loading 'fault' on Instance uuid 4545ddca-1552-48ca-96fe-f8a605e82b1b {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:04:43.451320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:43.458404 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-53c045b7-e0c6-461f-af19-a546e0c92107 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 200 len: 1312 microversion: 2.1 time: 0.095694 Aug 30 02:04:43.458879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 590/1145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:43 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:44.481848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:44.482546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 4545ddca-1552-48ca-96fe-f8a605e82b1b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:44.488619 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.489099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.489527 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.490211 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.490666 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.491085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.504803 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] HTTP exception thrown: Instance 4545ddca-1552-48ca-96fe-f8a605e82b1b could not be found. Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Request method failure captured: Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b HTTP/1.1 Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW6CH7rafVDf4Z49atCLViZ3JqK9FndKwadpATmAmjejXk-UMRbD6IDWbAEx9isb3LOGqCn3HFUiYljZOMTtY27lIE59l05A16SAbSpwxTuNaNf8VE8NsWO8DEt-mYiMRkVjGpfCnCmkLjQIxdO90EaVSI7HOs-2sZqlS7yDVykN_Iw Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 688f10cbc5ce42b895bb7a9285749cca Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:04:44.506425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_688f10cbc5ce42b895bb7a9285749cca"}]}] Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 688f10cbc5ce42b895bb7a9285749cca Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-ServerRescueNegativeTestJSON-108033553-project Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 86f364f03c7d4360b4a75ed194846ade Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-ServerRescueNegativeTestJSON-108033553-project Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 4545ddca-1552-48ca-96fe-f8a605e82b1b could not be found. Aug 30 02:04:44.507923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '4545ddca-1552-48ca-96fe-f8a605e82b1b'} Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4545ddca-1552-48ca-96fe-f8a605e82b1b could not be found. Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:04:44.509042 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4545ddca-1552-48ca-96fe-f8a605e82b1b could not be found. Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4545ddca-1552-48ca-96fe-f8a605e82b1b could not be found. Aug 30 02:04:44.510503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:04:44.511881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Returning 404 to user: Instance 4545ddca-1552-48ca-96fe-f8a605e82b1b could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:04:44.511881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3332fdc9-4069-4b50-a1b5-771f70816855 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b" status: 404 len: 111 microversion: 2.1 time: 0.031382 Aug 30 02:04:44.511881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 556/1146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:44 2022] GET /compute/v2.1/servers/4545ddca-1552-48ca-96fe-f8a605e82b1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:04:44.516586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3b445096-c1d4-4262-8d5c-11ddfc1bb263 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:44.517081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3b445096-c1d4-4262-8d5c-11ddfc1bb263 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:44.523320 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b445096-c1d4-4262-8d5c-11ddfc1bb263 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.523794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b445096-c1d4-4262-8d5c-11ddfc1bb263 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.524222 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b445096-c1d4-4262-8d5c-11ddfc1bb263 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.525029 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b445096-c1d4-4262-8d5c-11ddfc1bb263 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.525477 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b445096-c1d4-4262-8d5c-11ddfc1bb263 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.525893 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b445096-c1d4-4262-8d5c-11ddfc1bb263 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.550945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3b445096-c1d4-4262-8d5c-11ddfc1bb263 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Going to try to terminate instance {{(pid=120391) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:04:44.623540 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3b445096-c1d4-4262-8d5c-11ddfc1bb263 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "DELETE /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 204 len: 0 microversion: 2.1 time: 0.110556 Aug 30 02:04:44.624161 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 591/1147] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:04:44 2022] DELETE /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:04:44.632483 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-38309894-8ea9-48b1-aa88-5a7da7d21922 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:44.633171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-38309894-8ea9-48b1-aa88-5a7da7d21922 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:44.639399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38309894-8ea9-48b1-aa88-5a7da7d21922 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.639884 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38309894-8ea9-48b1-aa88-5a7da7d21922 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.640343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38309894-8ea9-48b1-aa88-5a7da7d21922 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.641031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38309894-8ea9-48b1-aa88-5a7da7d21922 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.641485 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38309894-8ea9-48b1-aa88-5a7da7d21922 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.641916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-38309894-8ea9-48b1-aa88-5a7da7d21922 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.771407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-38309894-8ea9-48b1-aa88-5a7da7d21922 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:44.779646 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-38309894-8ea9-48b1-aa88-5a7da7d21922 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.151114 Aug 30 02:04:44.780199 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 557/1148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:44 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:45.801179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3576bf53-fb35-49da-874e-69723af5e638 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:45.802215 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3576bf53-fb35-49da-874e-69723af5e638 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:45.808540 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3576bf53-fb35-49da-874e-69723af5e638 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:45.809019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3576bf53-fb35-49da-874e-69723af5e638 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:45.809449 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3576bf53-fb35-49da-874e-69723af5e638 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:45.810168 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3576bf53-fb35-49da-874e-69723af5e638 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:45.810613 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3576bf53-fb35-49da-874e-69723af5e638 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:45.811029 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3576bf53-fb35-49da-874e-69723af5e638 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:46.034740 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3576bf53-fb35-49da-874e-69723af5e638 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f364f03c7d4360b4a75ed194846ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688f10cbc5ce42b895bb7a9285749cca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:46.038222 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:46.043284 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3576bf53-fb35-49da-874e-69723af5e638 tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 200 len: 1521 microversion: 2.1 time: 0.246283 Aug 30 02:04:46.043884 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 592/1149] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:45 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:46.299568 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-8d6a98ca-1a80-404b-8c79-98a80c7888b5 req-e5743791-773e-4fc8-b494-0dc0d71be21f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48eb7084-94aa-46f2-911d-ca2463bfb25c", "name": "network-vif-deleted", "tag": "df6d0b90-2209-4de5-8e5b-ad7cb5df0caf"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:46.312092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8d6a98ca-1a80-404b-8c79-98a80c7888b5 req-e5743791-773e-4fc8-b494-0dc0d71be21f service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:46.313315 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8d6a98ca-1a80-404b-8c79-98a80c7888b5 req-e5743791-773e-4fc8-b494-0dc0d71be21f service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:46.313756 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-8d6a98ca-1a80-404b-8c79-98a80c7888b5 req-e5743791-773e-4fc8-b494-0dc0d71be21f service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:46.326320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-8d6a98ca-1a80-404b-8c79-98a80c7888b5 req-e5743791-773e-4fc8-b494-0dc0d71be21f service nova] Creating event network-vif-deleted:df6d0b90-2209-4de5-8e5b-ad7cb5df0caf for instance 48eb7084-94aa-46f2-911d-ca2463bfb25c on hv-cinder-81966 Aug 30 02:04:46.331099 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-8d6a98ca-1a80-404b-8c79-98a80c7888b5 req-e5743791-773e-4fc8-b494-0dc0d71be21f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035283 Aug 30 02:04:46.331684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 558/1150] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:47.064773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:47.065413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] [instance: 48eb7084-94aa-46f2-911d-ca2463bfb25c] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:47.074651 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:47.075140 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:47.075578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:47.076311 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:47.076775 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:47.077207 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:47.091929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] HTTP exception thrown: Instance 48eb7084-94aa-46f2-911d-ca2463bfb25c could not be found. Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Request method failure captured: Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c HTTP/1.1 Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW6CH7rafVDf4Z49atCLViZ3JqK9FndKwadpATmAmjejXk-UMRbD6IDWbAEx9isb3LOGqCn3HFUiYljZOMTtY27lIE59l05A16SAbSpwxTuNaNf8VE8NsWO8DEt-mYiMRkVjGpfCnCmkLjQIxdO90EaVSI7HOs-2sZqlS7yDVykN_Iw Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 688f10cbc5ce42b895bb7a9285749cca Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:04:47.093588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/688f10cbc5ce42b895bb7a9285749cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_688f10cbc5ce42b895bb7a9285749cca"}]}] Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 688f10cbc5ce42b895bb7a9285749cca Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-108033553 Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-ServerRescueNegativeTestJSON-108033553-project Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 86f364f03c7d4360b4a75ed194846ade Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-ServerRescueNegativeTestJSON-108033553-project Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 48eb7084-94aa-46f2-911d-ca2463bfb25c could not be found. Aug 30 02:04:47.095094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '48eb7084-94aa-46f2-911d-ca2463bfb25c'} Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48eb7084-94aa-46f2-911d-ca2463bfb25c could not be found. Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:04:47.095949 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48eb7084-94aa-46f2-911d-ca2463bfb25c could not be found. Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48eb7084-94aa-46f2-911d-ca2463bfb25c could not be found. Aug 30 02:04:47.097401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:04:47.098711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] Returning 404 to user: Instance 48eb7084-94aa-46f2-911d-ca2463bfb25c could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:04:47.098711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2b55e51d-a56f-4df6-adf9-ee9d81200dea tempest-ServerRescueNegativeTestJSON-108033553 tempest-ServerRescueNegativeTestJSON-108033553-project] 10.222.0.50 "GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c" status: 404 len: 111 microversion: 2.1 time: 0.035061 Aug 30 02:04:47.098711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 593/1151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:47 2022] GET /compute/v2.1/servers/48eb7084-94aa-46f2-911d-ca2463bfb25c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:04:54.358821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5e468f05-b12d-4cbd-b0f8-a5d8f6547ba7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:54.359264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5e468f05-b12d-4cbd-b0f8-a5d8f6547ba7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:54.361896 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-dbe04779-8da0-4a22-9ca6-0badaee8ba90 req-576d47fd-ca33-4bf1-82dd-966285ef9d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ee86d8-d269-493f-a24a-32c664d277d9", "tag": "f1dd3161-ede7-45be-a32c-472d4a0a6a58"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:54.367546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e468f05-b12d-4cbd-b0f8-a5d8f6547ba7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:54.368618 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e468f05-b12d-4cbd-b0f8-a5d8f6547ba7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:54.369694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e468f05-b12d-4cbd-b0f8-a5d8f6547ba7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:54.370694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e468f05-b12d-4cbd-b0f8-a5d8f6547ba7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:54.371644 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e468f05-b12d-4cbd-b0f8-a5d8f6547ba7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:54.372208 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5e468f05-b12d-4cbd-b0f8-a5d8f6547ba7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:54.373047 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-dbe04779-8da0-4a22-9ca6-0badaee8ba90 req-576d47fd-ca33-4bf1-82dd-966285ef9d68 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:54.373534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-dbe04779-8da0-4a22-9ca6-0badaee8ba90 req-576d47fd-ca33-4bf1-82dd-966285ef9d68 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:54.373965 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-dbe04779-8da0-4a22-9ca6-0badaee8ba90 req-576d47fd-ca33-4bf1-82dd-966285ef9d68 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:54.396981 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-dbe04779-8da0-4a22-9ca6-0badaee8ba90 req-576d47fd-ca33-4bf1-82dd-966285ef9d68 service nova] Creating event network-changed:f1dd3161-ede7-45be-a32c-472d4a0a6a58 for instance b5ee86d8-d269-493f-a24a-32c664d277d9 on hv-cinder-81966 Aug 30 02:04:54.406715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-dbe04779-8da0-4a22-9ca6-0badaee8ba90 req-576d47fd-ca33-4bf1-82dd-966285ef9d68 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048672 Aug 30 02:04:54.407883 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 594/1152] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:04:54.408835 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5e468f05-b12d-4cbd-b0f8-a5d8f6547ba7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:04:54.515831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5e468f05-b12d-4cbd-b0f8-a5d8f6547ba7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 204 len: 0 microversion: 2.1 time: 0.161054 Aug 30 02:04:54.516627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 559/1153] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:04:54 2022] DELETE /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:04:54.526699 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f37f13cb-4b50-4417-a0ec-bbf315f5e82b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:54.527823 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f37f13cb-4b50-4417-a0ec-bbf315f5e82b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:54.536366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f37f13cb-4b50-4417-a0ec-bbf315f5e82b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:54.537067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f37f13cb-4b50-4417-a0ec-bbf315f5e82b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:54.537660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f37f13cb-4b50-4417-a0ec-bbf315f5e82b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:54.539022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f37f13cb-4b50-4417-a0ec-bbf315f5e82b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:54.539668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f37f13cb-4b50-4417-a0ec-bbf315f5e82b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:54.540274 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f37f13cb-4b50-4417-a0ec-bbf315f5e82b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:54.720543 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f37f13cb-4b50-4417-a0ec-bbf315f5e82b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:54.731336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f37f13cb-4b50-4417-a0ec-bbf315f5e82b tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.210015 Aug 30 02:04:54.732117 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 595/1154] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:54 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:55.756475 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c536425c-049e-4e8d-b734-2947d6ee6711 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:55.757349 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c536425c-049e-4e8d-b734-2947d6ee6711 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:55.767371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c536425c-049e-4e8d-b734-2947d6ee6711 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:55.768227 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c536425c-049e-4e8d-b734-2947d6ee6711 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:55.769074 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c536425c-049e-4e8d-b734-2947d6ee6711 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:55.769974 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c536425c-049e-4e8d-b734-2947d6ee6711 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:55.770674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c536425c-049e-4e8d-b734-2947d6ee6711 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:55.771086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c536425c-049e-4e8d-b734-2947d6ee6711 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:55.955973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c536425c-049e-4e8d-b734-2947d6ee6711 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:55.970147 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c536425c-049e-4e8d-b734-2947d6ee6711 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1569 microversion: 2.1 time: 0.219376 Aug 30 02:04:55.971299 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 560/1155] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:55 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:56.992845 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-eacac60c-b962-4fb6-bb5e-78876bd4f8fe tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:56.993399 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-eacac60c-b962-4fb6-bb5e-78876bd4f8fe tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:57.000426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eacac60c-b962-4fb6-bb5e-78876bd4f8fe tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:57.000895 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eacac60c-b962-4fb6-bb5e-78876bd4f8fe tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:57.001525 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eacac60c-b962-4fb6-bb5e-78876bd4f8fe tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:57.002406 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eacac60c-b962-4fb6-bb5e-78876bd4f8fe tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:57.003043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eacac60c-b962-4fb6-bb5e-78876bd4f8fe tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:57.003648 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eacac60c-b962-4fb6-bb5e-78876bd4f8fe tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:57.217974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-eacac60c-b962-4fb6-bb5e-78876bd4f8fe tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:57.226408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-eacac60c-b962-4fb6-bb5e-78876bd4f8fe tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1451 microversion: 2.1 time: 0.237325 Aug 30 02:04:57.227161 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 596/1156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:56 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1451 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:57.434452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-11332d7e-a1f0-47b1-af92-4b4335fbac1a req-a8ac352d-63e1-4405-90ef-8de779000dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ee86d8-d269-493f-a24a-32c664d277d9", "name": "network-vif-deleted", "tag": "f1dd3161-ede7-45be-a32c-472d4a0a6a58"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:57.445770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-11332d7e-a1f0-47b1-af92-4b4335fbac1a req-a8ac352d-63e1-4405-90ef-8de779000dc1 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:57.446255 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-11332d7e-a1f0-47b1-af92-4b4335fbac1a req-a8ac352d-63e1-4405-90ef-8de779000dc1 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:57.446690 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-11332d7e-a1f0-47b1-af92-4b4335fbac1a req-a8ac352d-63e1-4405-90ef-8de779000dc1 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:57.465467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-11332d7e-a1f0-47b1-af92-4b4335fbac1a req-a8ac352d-63e1-4405-90ef-8de779000dc1 service nova] Creating event network-vif-deleted:f1dd3161-ede7-45be-a32c-472d4a0a6a58 for instance b5ee86d8-d269-493f-a24a-32c664d277d9 on hv-cinder-81966 Aug 30 02:04:57.471121 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-11332d7e-a1f0-47b1-af92-4b4335fbac1a req-a8ac352d-63e1-4405-90ef-8de779000dc1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041553 Aug 30 02:04:57.472205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 561/1157] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:58.247569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:58.248189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:58.255918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:58.256431 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:58.257052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:58.257996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:58.258606 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:58.259639 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:58.297971 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:58.298451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:58.298880 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:58.300065 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lazy-loading 'fault' on Instance uuid b5ee86d8-d269-493f-a24a-32c664d277d9 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:04:58.351040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fafe6ce050545b8870f88d4ae0aa1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c116c9cfbc144769d453e218b02739b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:58.360818 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-66d76c97-50f4-4a23-acbf-18d69ba53296 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 200 len: 1224 microversion: 2.1 time: 0.117719 Aug 30 02:04:58.364688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 597/1158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:58 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 1224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:59.140201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-689378bd-3e32-44ab-9de3-538e61426a92 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:59.140794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-689378bd-3e32-44ab-9de3-538e61426a92 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:59.142626 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:59.148174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-689378bd-3e32-44ab-9de3-538e61426a92 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:59.148676 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-689378bd-3e32-44ab-9de3-538e61426a92 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:59.149105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-689378bd-3e32-44ab-9de3-538e61426a92 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:59.149785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-689378bd-3e32-44ab-9de3-538e61426a92 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:59.150259 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-689378bd-3e32-44ab-9de3-538e61426a92 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:59.150674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-689378bd-3e32-44ab-9de3-538e61426a92 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:59.154339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:59.179941 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-689378bd-3e32-44ab-9de3-538e61426a92 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:04:59.253729 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-689378bd-3e32-44ab-9de3-538e61426a92 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 204 len: 0 microversion: 2.1 time: 0.126736 Aug 30 02:04:59.254406 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 562/1159] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:04:59 2022] DELETE /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:04:59.265047 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-68dd27d2-9573-4f90-9695-d92ae6016ff4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:59.265809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-68dd27d2-9573-4f90-9695-d92ae6016ff4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:59.268387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=3 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:59.274512 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68dd27d2-9573-4f90-9695-d92ae6016ff4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:59.274905 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68dd27d2-9573-4f90-9695-d92ae6016ff4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:59.275489 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68dd27d2-9573-4f90-9695-d92ae6016ff4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:59.276258 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68dd27d2-9573-4f90-9695-d92ae6016ff4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:59.276861 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68dd27d2-9573-4f90-9695-d92ae6016ff4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:59.277494 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-68dd27d2-9573-4f90-9695-d92ae6016ff4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:59.382904 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:59.383723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] [instance: b5ee86d8-d269-493f-a24a-32c664d277d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:59.389949 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:59.390567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:59.391012 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:59.391772 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:59.392337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:59.392815 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:59.407381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] HTTP exception thrown: Instance b5ee86d8-d269-493f-a24a-32c664d277d9 could not be found. Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Request method failure captured: Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 HTTP/1.1 Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW5yPiNTavIHaszg17pUc9Is6UzizjaTC7eSHNmhMO57zeQl788cZ82EBNZOkodv6L5z2i9Ko_GwbEqe1ySA8uKgAHS0H8prAQvflJVxEh5uAHBclzJFxjk-mTjZtr-bxTJgDS2cSKz7B1Big3f-wX8fzdZDdvLeieeISBplg9y_rTc Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 7c116c9cfbc144769d453e218b02739b Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-TestShelveInstance-637637181 Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:04:59.409041 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7c116c9cfbc144769d453e218b02739b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7c116c9cfbc144769d453e218b02739b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7c116c9cfbc144769d453e218b02739b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7c116c9cfbc144769d453e218b02739b"}]}] Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-TestShelveInstance-637637181 Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 7c116c9cfbc144769d453e218b02739b Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-TestShelveInstance-637637181 Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-TestShelveInstance-637637181-project Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 1fafe6ce050545b8870f88d4ae0aa1ca Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-TestShelveInstance-637637181-project Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance b5ee86d8-d269-493f-a24a-32c664d277d9 could not be found. Aug 30 02:04:59.410447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': 'b5ee86d8-d269-493f-a24a-32c664d277d9'} Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ee86d8-d269-493f-a24a-32c664d277d9 could not be found. Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:04:59.411348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ee86d8-d269-493f-a24a-32c664d277d9 could not be found. Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ee86d8-d269-493f-a24a-32c664d277d9 could not be found. Aug 30 02:04:59.413230 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:04:59.414645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Returning 404 to user: Instance b5ee86d8-d269-493f-a24a-32c664d277d9 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:04:59.414645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7cf9641e-46d2-4475-b91f-c35b78a5b5c7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9" status: 404 len: 111 microversion: 2.1 time: 0.032249 Aug 30 02:04:59.414645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 563/1160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:59 2022] GET /compute/v2.1/servers/b5ee86d8-d269-493f-a24a-32c664d277d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:04:59.417357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-68dd27d2-9573-4f90-9695-d92ae6016ff4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:59.426205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-68dd27d2-9573-4f90-9695-d92ae6016ff4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1576 microversion: 2.1 time: 0.164852 Aug 30 02:04:59.426754 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 598/1161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:59 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:59.586570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-38d6005e-d8a1-4da0-bb04-3f5cbffcfad7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] Calling method '.version_select at 0x7f3b0833f280>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:59.610373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-38d6005e-d8a1-4da0-bb04-3f5cbffcfad7 tempest-TestShelveInstance-637637181 tempest-TestShelveInstance-637637181-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1268717129" status: 202 len: 0 microversion: 2.1 time: 0.028008 Aug 30 02:04:59.610980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 564/1162] 10.222.0.50 () {58 vars in 1254 bytes} [Tue Aug 30 02:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1268717129 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:05:00.447972 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-52f8e57d-c976-42f7-89f3-43bb25bd2d88 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:00.448701 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-52f8e57d-c976-42f7-89f3-43bb25bd2d88 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:00.456799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52f8e57d-c976-42f7-89f3-43bb25bd2d88 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:00.458131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52f8e57d-c976-42f7-89f3-43bb25bd2d88 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:00.458946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52f8e57d-c976-42f7-89f3-43bb25bd2d88 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:00.460210 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52f8e57d-c976-42f7-89f3-43bb25bd2d88 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:00.461114 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52f8e57d-c976-42f7-89f3-43bb25bd2d88 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:00.461917 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52f8e57d-c976-42f7-89f3-43bb25bd2d88 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:00.636570 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-52f8e57d-c976-42f7-89f3-43bb25bd2d88 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:00.644121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-52f8e57d-c976-42f7-89f3-43bb25bd2d88 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1576 microversion: 2.1 time: 0.201097 Aug 30 02:05:00.644912 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 599/1163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:00 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:01.666279 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-666ca417-c125-4a03-aebd-4fba52d0ffb6 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:01.667052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-666ca417-c125-4a03-aebd-4fba52d0ffb6 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:01.674445 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-666ca417-c125-4a03-aebd-4fba52d0ffb6 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:01.675074 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-666ca417-c125-4a03-aebd-4fba52d0ffb6 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:01.675512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-666ca417-c125-4a03-aebd-4fba52d0ffb6 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:01.676208 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-666ca417-c125-4a03-aebd-4fba52d0ffb6 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:01.676888 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-666ca417-c125-4a03-aebd-4fba52d0ffb6 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:01.677476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-666ca417-c125-4a03-aebd-4fba52d0ffb6 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:01.823187 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-666ca417-c125-4a03-aebd-4fba52d0ffb6 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:01.832760 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-666ca417-c125-4a03-aebd-4fba52d0ffb6 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1576 microversion: 2.1 time: 0.170360 Aug 30 02:05:01.834248 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 565/1164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:01 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:02.860068 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b9f412f8-2dc0-4fe6-bdcd-7e07f3240002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:02.863561 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b9f412f8-2dc0-4fe6-bdcd-7e07f3240002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:02.874633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9f412f8-2dc0-4fe6-bdcd-7e07f3240002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:02.876128 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9f412f8-2dc0-4fe6-bdcd-7e07f3240002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:02.877225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9f412f8-2dc0-4fe6-bdcd-7e07f3240002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:02.877842 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9f412f8-2dc0-4fe6-bdcd-7e07f3240002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:02.878386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9f412f8-2dc0-4fe6-bdcd-7e07f3240002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:02.878806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b9f412f8-2dc0-4fe6-bdcd-7e07f3240002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:02.986027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b9f412f8-2dc0-4fe6-bdcd-7e07f3240002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:03.001445 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b9f412f8-2dc0-4fe6-bdcd-7e07f3240002 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1510 microversion: 2.1 time: 0.150676 Aug 30 02:05:03.005368 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 600/1165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:02 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:03.093510 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-aed03fae-c43f-4b59-b3ef-074494af71e8 req-bf86e130-7856-4a13-99df-ca0062fd9d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e06f030-1187-44b2-bf6d-dfff52fbbc06", "name": "network-vif-deleted", "tag": "0275d53a-fdb2-4036-b793-03c933bc3ad0"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:03.111438 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-aed03fae-c43f-4b59-b3ef-074494af71e8 req-bf86e130-7856-4a13-99df-ca0062fd9d95 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:03.111913 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-aed03fae-c43f-4b59-b3ef-074494af71e8 req-bf86e130-7856-4a13-99df-ca0062fd9d95 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:03.112547 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-aed03fae-c43f-4b59-b3ef-074494af71e8 req-bf86e130-7856-4a13-99df-ca0062fd9d95 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:03.129129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-aed03fae-c43f-4b59-b3ef-074494af71e8 req-bf86e130-7856-4a13-99df-ca0062fd9d95 service nova] Creating event network-vif-deleted:0275d53a-fdb2-4036-b793-03c933bc3ad0 for instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 on hv-cinder-81966 Aug 30 02:05:03.135646 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-aed03fae-c43f-4b59-b3ef-074494af71e8 req-bf86e130-7856-4a13-99df-ca0062fd9d95 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046205 Aug 30 02:05:03.136617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 566/1166] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:04.025863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:04.026483 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:04.033444 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:04.034113 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:04.034912 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:04.035833 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:04.036304 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:04.036975 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:04.072740 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:04.073782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:04.074455 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:04.075274 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lazy-loading 'fault' on Instance uuid 8e06f030-1187-44b2-bf6d-dfff52fbbc06 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:05:04.136198 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:04.144452 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-41bca57a-801e-4a7a-81ae-737a6cd5147c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 200 len: 1230 microversion: 2.1 time: 0.122940 Aug 30 02:05:04.144876 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 601/1167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:04 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 1230 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:05.167891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:05.168722 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:05.177405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:05.178132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:05.178720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:05.179604 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:05.180202 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:05.180829 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:05.196761 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] HTTP exception thrown: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Request method failure captured: Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 HTTP/1.1 Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW9dawDWRtJtjMU6KdKbEmXAPBhhIMtn9a6gB8cVwwKvIIxXiA1Jsta1EeLQVPhUGxnF1JDV5cJpuQ4ss1hVjVs5hAIIr5zaGnf5LX-x4hh6WcwjWTsdBBZuZjDtI4E_iime9UcVqhQGI4hMHimzEqHuMNi_-FO6Q5G4XMxj7mLcivo Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 74610e8b7b4d4fafa0e49ba73b94aa48 Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-TestVolumeBootPattern-220186124 Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:05:05.198601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74610e8b7b4d4fafa0e49ba73b94aa48"}]}] Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-TestVolumeBootPattern-220186124 Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 74610e8b7b4d4fafa0e49ba73b94aa48 Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-TestVolumeBootPattern-220186124 Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-TestVolumeBootPattern-220186124-project Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: bd08361520db465bb9069326d03d0307 Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-TestVolumeBootPattern-220186124-project Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:05:05.199940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '8e06f030-1187-44b2-bf6d-dfff52fbbc06'} Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:05:05.200861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:05:05.202098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:05.204683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Returning 404 to user: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:05:05.205808 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ae67e522-2d49-4f58-8404-0855083488f4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 404 len: 111 microversion: 2.1 time: 0.043306 Aug 30 02:05:05.216487 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 567/1168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:05 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:05:05.368434 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-305872586", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2051291069", "security_groups": [{"name": "tempest-secgroup-smoke-83394517"}], "block_device_mapping_v2": [{"uuid": "59f1b453-8893-422f-b724-2f277dd92906", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6493208c-2d03-4273-9fca-307a3c4e68fa"}]}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:05.744233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.network.neutron [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] validate_networks() for [('6493208c-2d03-4273-9fca-307a3c4e68fa', None, None, None, None, None)] {{(pid=120391) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:05:06.478951 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Flavor limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:05:06.480282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Image limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:05:06.480969 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Flavor pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:05:06.481743 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Image pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:05:06.482206 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:05:06.491596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:06.492131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:06.492795 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:06.494096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:06.494783 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:06.495783 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:06.516325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Getting quotas for project 74610e8b7b4d4fafa0e49ba73b94aa48. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:05:06.522363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Getting quotas for user bd08361520db465bb9069326d03d0307 and project 74610e8b7b4d4fafa0e49ba73b94aa48. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:05:06.586498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Going to run 1 instances... {{(pid=120391) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:05:06.589288 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59f1b453-8893-422f-b724-2f277dd92906',volume_size=None,volume_type=None)] {{(pid=120391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:05:06.747716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f7ea68fe-5046-42d7-88d0-ccd9185c3d0d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.383624 Aug 30 02:05:06.748969 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 602/1169] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 02:05:05 2022] POST /compute/v2.1/servers => generated 404 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 02:05:06.761629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f0fa0bb0-ffaa-49aa-8942-eb25d9eaf519 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:06.762308 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f0fa0bb0-ffaa-49aa-8942-eb25d9eaf519 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:06.910351 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f0fa0bb0-ffaa-49aa-8942-eb25d9eaf519 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:06.928902 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f0fa0bb0-ffaa-49aa-8942-eb25d9eaf519 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1094 microversion: 2.1 time: 0.173291 Aug 30 02:05:06.931559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 568/1170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:06 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1094 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:07.955473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0a8c93a6-e0c2-446e-b4cc-363fe9c6f007 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:07.956111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0a8c93a6-e0c2-446e-b4cc-363fe9c6f007 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:07.967908 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a8c93a6-e0c2-446e-b4cc-363fe9c6f007 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:07.968434 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a8c93a6-e0c2-446e-b4cc-363fe9c6f007 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:07.968876 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a8c93a6-e0c2-446e-b4cc-363fe9c6f007 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:07.969586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a8c93a6-e0c2-446e-b4cc-363fe9c6f007 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:07.970045 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a8c93a6-e0c2-446e-b4cc-363fe9c6f007 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:07.970475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a8c93a6-e0c2-446e-b4cc-363fe9c6f007 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:08.031685 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-df851a9c-f100-4911-a2e4-2d734ffb30fd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:08.033974 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-df851a9c-f100-4911-a2e4-2d734ffb30fd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:08.046683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df851a9c-f100-4911-a2e4-2d734ffb30fd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:08.047226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df851a9c-f100-4911-a2e4-2d734ffb30fd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:08.047654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df851a9c-f100-4911-a2e4-2d734ffb30fd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:08.048606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df851a9c-f100-4911-a2e4-2d734ffb30fd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:08.048841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df851a9c-f100-4911-a2e4-2d734ffb30fd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:08.049269 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-df851a9c-f100-4911-a2e4-2d734ffb30fd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:08.087869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0a8c93a6-e0c2-446e-b4cc-363fe9c6f007 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:08.093174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-df851a9c-f100-4911-a2e4-2d734ffb30fd tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065325 Aug 30 02:05:08.094325 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 569/1171] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:08 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 02:05:08.096120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0a8c93a6-e0c2-446e-b4cc-363fe9c6f007 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1192 microversion: 2.1 time: 0.149063 Aug 30 02:05:08.101177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 603/1172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:07 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1192 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:08.188061 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bb02a4e5-cc79-4826-8a6c-159e3f6f4441 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:08.188849 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bb02a4e5-cc79-4826-8a6c-159e3f6f4441 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:08.195165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb02a4e5-cc79-4826-8a6c-159e3f6f4441 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:08.195648 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb02a4e5-cc79-4826-8a6c-159e3f6f4441 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:08.196081 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb02a4e5-cc79-4826-8a6c-159e3f6f4441 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:08.198062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb02a4e5-cc79-4826-8a6c-159e3f6f4441 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:08.198614 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb02a4e5-cc79-4826-8a6c-159e3f6f4441 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:08.198947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb02a4e5-cc79-4826-8a6c-159e3f6f4441 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:08.231107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bb02a4e5-cc79-4826-8a6c-159e3f6f4441 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:05:08.330051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bb02a4e5-cc79-4826-8a6c-159e3f6f4441 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 204 len: 0 microversion: 2.1 time: 0.145543 Aug 30 02:05:08.330737 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 570/1173] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:05:08 2022] DELETE /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:05:08.339138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9cc6a619-cf12-4d55-8cad-abdedd326cf4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:08.339746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9cc6a619-cf12-4d55-8cad-abdedd326cf4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:08.345991 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9cc6a619-cf12-4d55-8cad-abdedd326cf4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:08.346684 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9cc6a619-cf12-4d55-8cad-abdedd326cf4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:08.347121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9cc6a619-cf12-4d55-8cad-abdedd326cf4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:08.347814 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9cc6a619-cf12-4d55-8cad-abdedd326cf4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:08.348354 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9cc6a619-cf12-4d55-8cad-abdedd326cf4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:08.348774 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9cc6a619-cf12-4d55-8cad-abdedd326cf4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:08.494402 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9cc6a619-cf12-4d55-8cad-abdedd326cf4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:08.502128 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9cc6a619-cf12-4d55-8cad-abdedd326cf4 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1672 microversion: 2.1 time: 0.166840 Aug 30 02:05:08.502686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 604/1174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:08 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:09.124851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4f0e6329-537b-4828-83b4-635476c6688a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:09.125673 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4f0e6329-537b-4828-83b4-635476c6688a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:09.132615 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f0e6329-537b-4828-83b4-635476c6688a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:09.133115 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f0e6329-537b-4828-83b4-635476c6688a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:09.133550 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f0e6329-537b-4828-83b4-635476c6688a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:09.134534 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f0e6329-537b-4828-83b4-635476c6688a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:09.135160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f0e6329-537b-4828-83b4-635476c6688a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:09.135963 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f0e6329-537b-4828-83b4-635476c6688a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:09.209473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4f0e6329-537b-4828-83b4-635476c6688a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:09.220212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4f0e6329-537b-4828-83b4-635476c6688a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1200 microversion: 2.1 time: 0.100283 Aug 30 02:05:09.233381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 571/1175] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:09 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1200 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:09.526443 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-86df11b5-e7ec-4e05-b14e-8c202b5b19f7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:09.527596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-86df11b5-e7ec-4e05-b14e-8c202b5b19f7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:09.535067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86df11b5-e7ec-4e05-b14e-8c202b5b19f7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:09.536102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86df11b5-e7ec-4e05-b14e-8c202b5b19f7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:09.536793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86df11b5-e7ec-4e05-b14e-8c202b5b19f7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:09.559033 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86df11b5-e7ec-4e05-b14e-8c202b5b19f7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:09.559700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86df11b5-e7ec-4e05-b14e-8c202b5b19f7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:09.560471 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-86df11b5-e7ec-4e05-b14e-8c202b5b19f7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:09.788907 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-86df11b5-e7ec-4e05-b14e-8c202b5b19f7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:09.798645 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-86df11b5-e7ec-4e05-b14e-8c202b5b19f7 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1672 microversion: 2.1 time: 0.277596 Aug 30 02:05:09.799395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 605/1176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:09 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1672 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:10.244556 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5a5b3991-0a5c-4c72-a500-72d0c162868a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:10.246340 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5a5b3991-0a5c-4c72-a500-72d0c162868a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:10.253129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a5b3991-0a5c-4c72-a500-72d0c162868a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:10.254222 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a5b3991-0a5c-4c72-a500-72d0c162868a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:10.254816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a5b3991-0a5c-4c72-a500-72d0c162868a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:10.255692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a5b3991-0a5c-4c72-a500-72d0c162868a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:10.256391 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a5b3991-0a5c-4c72-a500-72d0c162868a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:10.256979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5a5b3991-0a5c-4c72-a500-72d0c162868a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:10.412530 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5a5b3991-0a5c-4c72-a500-72d0c162868a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:10.421082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5a5b3991-0a5c-4c72-a500-72d0c162868a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1276 microversion: 2.1 time: 0.181409 Aug 30 02:05:10.422873 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 572/1177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:10 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:10.826778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0f7be6a6-dae4-4726-8a84-6df51ecf4e91 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:10.827404 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0f7be6a6-dae4-4726-8a84-6df51ecf4e91 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:10.834515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f7be6a6-dae4-4726-8a84-6df51ecf4e91 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:10.835192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f7be6a6-dae4-4726-8a84-6df51ecf4e91 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:10.835759 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f7be6a6-dae4-4726-8a84-6df51ecf4e91 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:10.836906 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f7be6a6-dae4-4726-8a84-6df51ecf4e91 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:10.838180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f7be6a6-dae4-4726-8a84-6df51ecf4e91 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:10.838612 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0f7be6a6-dae4-4726-8a84-6df51ecf4e91 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:11.284167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0f7be6a6-dae4-4726-8a84-6df51ecf4e91 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:11.294765 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0f7be6a6-dae4-4726-8a84-6df51ecf4e91 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1672 microversion: 2.1 time: 0.471670 Aug 30 02:05:11.305297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 606/1178] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:10 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1672 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:11.443295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d37fd197-5f6d-446c-9617-fc2067135bed tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:11.443903 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d37fd197-5f6d-446c-9617-fc2067135bed tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:11.450724 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d37fd197-5f6d-446c-9617-fc2067135bed tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:11.451443 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d37fd197-5f6d-446c-9617-fc2067135bed tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:11.452069 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d37fd197-5f6d-446c-9617-fc2067135bed tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:11.452948 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d37fd197-5f6d-446c-9617-fc2067135bed tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:11.453402 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d37fd197-5f6d-446c-9617-fc2067135bed tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:11.453824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d37fd197-5f6d-446c-9617-fc2067135bed tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:11.584191 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d37fd197-5f6d-446c-9617-fc2067135bed tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:11.591974 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d37fd197-5f6d-446c-9617-fc2067135bed tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.152745 Aug 30 02:05:11.592624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 573/1179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:11 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:11.761048 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-9a0aa876-9e49-4eae-8713-d508bd14f07f req-48fcd81d-a75b-4335-8465-2656d07bbd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d175d1c1-24a5-488c-87b9-6de5c2b20479", "tag": "4b5a253a-9dd3-4c0d-a265-de8c1a9ebbed"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:11.785385 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9a0aa876-9e49-4eae-8713-d508bd14f07f req-48fcd81d-a75b-4335-8465-2656d07bbd5e service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:11.786518 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9a0aa876-9e49-4eae-8713-d508bd14f07f req-48fcd81d-a75b-4335-8465-2656d07bbd5e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:11.789356 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-9a0aa876-9e49-4eae-8713-d508bd14f07f req-48fcd81d-a75b-4335-8465-2656d07bbd5e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:11.805113 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-9a0aa876-9e49-4eae-8713-d508bd14f07f req-48fcd81d-a75b-4335-8465-2656d07bbd5e service nova] Creating event network-changed:4b5a253a-9dd3-4c0d-a265-de8c1a9ebbed for instance d175d1c1-24a5-488c-87b9-6de5c2b20479 on hv-cinder-81966 Aug 30 02:05:11.814133 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-9a0aa876-9e49-4eae-8713-d508bd14f07f req-48fcd81d-a75b-4335-8465-2656d07bbd5e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058419 Aug 30 02:05:11.815043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 607/1180] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:12.315101 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:12.315812 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:12.322556 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:12.323179 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:12.323735 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:12.324683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:12.325297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:12.325871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:12.357383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:12.357987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:12.358523 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:12.358975 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lazy-loading 'fault' on Instance uuid 1cf13980-f99e-4a83-9ec5-95e80147696b {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:05:12.406293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:12.414316 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e334d769-8cd8-4f58-b483-d378089cb1f1 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1327 microversion: 2.1 time: 0.103156 Aug 30 02:05:12.414882 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 574/1181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:12 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:12.614183 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ec749996-4802-43d3-b6d8-0f82f5cfaa20 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:12.614873 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ec749996-4802-43d3-b6d8-0f82f5cfaa20 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:12.621122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec749996-4802-43d3-b6d8-0f82f5cfaa20 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:12.621597 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec749996-4802-43d3-b6d8-0f82f5cfaa20 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:12.622029 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec749996-4802-43d3-b6d8-0f82f5cfaa20 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:12.622721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec749996-4802-43d3-b6d8-0f82f5cfaa20 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:12.623168 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec749996-4802-43d3-b6d8-0f82f5cfaa20 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:12.623590 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ec749996-4802-43d3-b6d8-0f82f5cfaa20 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:12.757774 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ec749996-4802-43d3-b6d8-0f82f5cfaa20 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:12.765810 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ec749996-4802-43d3-b6d8-0f82f5cfaa20 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.156286 Aug 30 02:05:12.766452 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 608/1182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:12 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:13.437241 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:13.438079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:13.445028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:13.445585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:13.446106 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:13.447424 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:13.448160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:13.449017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:13.480403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:13.480947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:13.481381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:13.481825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lazy-loading 'fault' on Instance uuid 1cf13980-f99e-4a83-9ec5-95e80147696b {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:05:13.522825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:13.530457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e085b8a2-3b73-4c12-b860-f0749121681e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 200 len: 1327 microversion: 2.1 time: 0.098592 Aug 30 02:05:13.531008 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 575/1183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:13 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:13.788186 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-78036279-3125-4a2b-a32a-b2998b3a27dc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:13.788828 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-78036279-3125-4a2b-a32a-b2998b3a27dc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:13.796696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78036279-3125-4a2b-a32a-b2998b3a27dc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:13.797174 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78036279-3125-4a2b-a32a-b2998b3a27dc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:13.797606 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78036279-3125-4a2b-a32a-b2998b3a27dc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:13.798298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78036279-3125-4a2b-a32a-b2998b3a27dc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:13.798751 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78036279-3125-4a2b-a32a-b2998b3a27dc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:13.799171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-78036279-3125-4a2b-a32a-b2998b3a27dc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:13.848373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-c21ff7c5-4642-41e9-be6a-27f53d324814 req-65e6ef24-b094-419b-9dc3-71e931c729ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf13980-f99e-4a83-9ec5-95e80147696b", "name": "network-vif-deleted", "tag": "73d5c135-a67f-4c18-bc03-d0162506c894"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:13.861847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-c21ff7c5-4642-41e9-be6a-27f53d324814 req-65e6ef24-b094-419b-9dc3-71e931c729ec service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:13.862425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-c21ff7c5-4642-41e9-be6a-27f53d324814 req-65e6ef24-b094-419b-9dc3-71e931c729ec service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:13.862923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-c21ff7c5-4642-41e9-be6a-27f53d324814 req-65e6ef24-b094-419b-9dc3-71e931c729ec service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:13.874823 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-c21ff7c5-4642-41e9-be6a-27f53d324814 req-65e6ef24-b094-419b-9dc3-71e931c729ec service nova] Creating event network-vif-deleted:73d5c135-a67f-4c18-bc03-d0162506c894 for instance 1cf13980-f99e-4a83-9ec5-95e80147696b on hv-cinder-81966 Aug 30 02:05:13.880125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-c21ff7c5-4642-41e9-be6a-27f53d324814 req-65e6ef24-b094-419b-9dc3-71e931c729ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036502 Aug 30 02:05:13.881082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 576/1184] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:14.019220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-78036279-3125-4a2b-a32a-b2998b3a27dc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:14.027336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-78036279-3125-4a2b-a32a-b2998b3a27dc tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.243846 Aug 30 02:05:14.027903 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 609/1185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:13 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:14.553246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:14.553945 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:14.560174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:14.560689 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:14.561124 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:14.561812 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:14.562263 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:14.562686 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:14.576560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] HTTP exception thrown: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Request method failure captured: Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b HTTP/1.1 Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4aEGGc3qQXi6Sw2tM7wlB2sHMzDPZSPC9XnUwy1pmJWqX6dmIq8Wu0CUU5OpOeUildq7CRzbza2aV7cZpm5NXnBXWoyON4w-Vg3ze-jR8rq5kityYVrYTVFJaeDScEWT1t726QznTpEk-4OgazQ6rG2oM1wloX0BzO4iuLQJw_034 Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:05:14.578131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f90f06a31df841b89ed6874d20340475"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f90f06a31df841b89ed6874d20340475"}]}] Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 68fcefa4a0db4bd6a051b1446e1a0d2d Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:05:14.579710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '1cf13980-f99e-4a83-9ec5-95e80147696b'} Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:05:14.580900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:05:14.582441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:14.583921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Returning 404 to user: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:05:14.583921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ac9870be-a42b-4d99-9acb-195855f30142 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 404 len: 111 microversion: 2.1 time: 0.031089 Aug 30 02:05:14.583921 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 577/1186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:14 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:05:14.589112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-156ca5bf-b401-4baf-b4f4-880574c147fa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '.version_select at 0x7f3b03f8b280>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:14.608811 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-156ca5bf-b401-4baf-b4f4-880574c147fa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-265171136" status: 202 len: 0 microversion: 2.1 time: 0.024099 Aug 30 02:05:14.609366 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 610/1187] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 02:05:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-265171136 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:05:15.047941 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ff8a6788-83a9-4f5a-aa77-005150846ed3 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:15.048697 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ff8a6788-83a9-4f5a-aa77-005150846ed3 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:15.054675 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8a6788-83a9-4f5a-aa77-005150846ed3 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:15.055279 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8a6788-83a9-4f5a-aa77-005150846ed3 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:15.055782 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8a6788-83a9-4f5a-aa77-005150846ed3 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:15.057171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8a6788-83a9-4f5a-aa77-005150846ed3 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:15.057691 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8a6788-83a9-4f5a-aa77-005150846ed3 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:15.058181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ff8a6788-83a9-4f5a-aa77-005150846ed3 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:15.273239 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ff8a6788-83a9-4f5a-aa77-005150846ed3 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:15.281159 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ff8a6788-83a9-4f5a-aa77-005150846ed3 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.236961 Aug 30 02:05:15.281755 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 578/1188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:15 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:15.330938 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9bd68e34-bcbb-4a07-bc64-109008a27956 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'create', calling method: .version_select at 0x7f3b0822eaf0>, body: {"keypair": {"name": "tempest-keypair-1615322121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES3GGjxLop4I2bg70Xdfmljrkk1apdBiyTg0dvB0RtrmDBsHWn7ulLfeMvjRmQmuT/7UyWfdJrkemorKAHUE+tqBgVPM43jzKbU7MoYX1VgpS6DeqxGVDk27L7yLH1SvA=="}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:15.346325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-9bd68e34-bcbb-4a07-bc64-109008a27956 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Getting quotas for project f90f06a31df841b89ed6874d20340475. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:05:15.350304 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-9bd68e34-bcbb-4a07-bc64-109008a27956 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Getting quotas for user 68fcefa4a0db4bd6a051b1446e1a0d2d and project f90f06a31df841b89ed6874d20340475. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:05:15.372499 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9bd68e34-bcbb-4a07-bc64-109008a27956 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045829 Aug 30 02:05:15.373077 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 611/1189] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 02:05:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:16.303229 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bb3e7d33-15f4-4f55-b226-983e79bce522 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:16.303846 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bb3e7d33-15f4-4f55-b226-983e79bce522 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:16.310689 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e7d33-15f4-4f55-b226-983e79bce522 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:16.311174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e7d33-15f4-4f55-b226-983e79bce522 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:16.311606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e7d33-15f4-4f55-b226-983e79bce522 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:16.312336 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e7d33-15f4-4f55-b226-983e79bce522 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:16.312855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e7d33-15f4-4f55-b226-983e79bce522 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:16.313283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb3e7d33-15f4-4f55-b226-983e79bce522 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:16.525115 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb3e7d33-15f4-4f55-b226-983e79bce522 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:16.532908 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bb3e7d33-15f4-4f55-b226-983e79bce522 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.233643 Aug 30 02:05:16.533473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 579/1190] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:16 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:16.710169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:16.715166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-200425208", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64655386-6e9d-441e-8ba3-b8d8487789cf"}], "security_groups": [{"name": "tempest-securitygroup--1355627501"}], "key_name": "tempest-keypair-1615322121", "user_data": "}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:16.815953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.network.neutron [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] validate_networks() for [('64655386-6e9d-441e-8ba3-b8d8487789cf', None, None, None, None, None)] {{(pid=120391) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:05:17.196043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Flavor limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:05:17.196659 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Image limits 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:05:17.197138 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Flavor pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:05:17.197547 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Image pref 0:0:0 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:05:17.197961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.virt.hardware [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:05:17.207213 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:17.207728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:17.208167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:17.208929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:17.209385 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:17.209812 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:17.217941 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=91 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:17.229599 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Getting quotas for project f90f06a31df841b89ed6874d20340475. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:05:17.233561 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Getting quotas for user 68fcefa4a0db4bd6a051b1446e1a0d2d and project f90f06a31df841b89ed6874d20340475. Resources: {'ram', 'cores', 'instances'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:05:17.244322 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Going to run 1 instances... {{(pid=120391) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:05:17.246646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:05:17.293943 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5e4f437e-a035-4e6e-af17-da5da77fe233 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.584939 Aug 30 02:05:17.294769 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 612/1191] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 02:05:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:05:17.305685 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-802a729d-5228-4921-bf29-003c4dc0bff6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:17.306428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-802a729d-5228-4921-bf29-003c4dc0bff6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:17.308418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:17.369193 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-802a729d-5228-4921-bf29-003c4dc0bff6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:17.375988 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-802a729d-5228-4921-bf29-003c4dc0bff6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1237 microversion: 2.1 time: 0.074156 Aug 30 02:05:17.376721 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 580/1192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:17 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:17.554430 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-94f3e5af-8497-4e3e-bb1a-be42a4718c1f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:17.555036 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-94f3e5af-8497-4e3e-bb1a-be42a4718c1f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:17.561353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-94f3e5af-8497-4e3e-bb1a-be42a4718c1f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:17.561835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-94f3e5af-8497-4e3e-bb1a-be42a4718c1f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:17.562265 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-94f3e5af-8497-4e3e-bb1a-be42a4718c1f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:17.562978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-94f3e5af-8497-4e3e-bb1a-be42a4718c1f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:17.563426 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-94f3e5af-8497-4e3e-bb1a-be42a4718c1f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:17.563845 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-94f3e5af-8497-4e3e-bb1a-be42a4718c1f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:17.694465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-94f3e5af-8497-4e3e-bb1a-be42a4718c1f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:17.702806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-94f3e5af-8497-4e3e-bb1a-be42a4718c1f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.152273 Aug 30 02:05:17.703377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 613/1193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:17 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:18.398040 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e4ff74b9-7a43-4ef8-8d47-4f4cd33ff9de tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:18.398604 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e4ff74b9-7a43-4ef8-8d47-4f4cd33ff9de tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:18.405772 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4ff74b9-7a43-4ef8-8d47-4f4cd33ff9de tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:18.406262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4ff74b9-7a43-4ef8-8d47-4f4cd33ff9de tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:18.406698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4ff74b9-7a43-4ef8-8d47-4f4cd33ff9de tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:18.407395 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4ff74b9-7a43-4ef8-8d47-4f4cd33ff9de tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:18.407855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4ff74b9-7a43-4ef8-8d47-4f4cd33ff9de tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:18.408303 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e4ff74b9-7a43-4ef8-8d47-4f4cd33ff9de tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:18.423311 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:18.473529 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e4ff74b9-7a43-4ef8-8d47-4f4cd33ff9de tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:18.482570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e4ff74b9-7a43-4ef8-8d47-4f4cd33ff9de tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1297 microversion: 2.1 time: 0.088384 Aug 30 02:05:18.483188 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 581/1194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:18 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:18.723125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f4e95e1c-434a-4316-a95d-8cfd8978e715 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:18.723655 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f4e95e1c-434a-4316-a95d-8cfd8978e715 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:18.730680 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e95e1c-434a-4316-a95d-8cfd8978e715 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:18.731158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e95e1c-434a-4316-a95d-8cfd8978e715 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:18.731586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e95e1c-434a-4316-a95d-8cfd8978e715 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:18.732292 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e95e1c-434a-4316-a95d-8cfd8978e715 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:18.732749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e95e1c-434a-4316-a95d-8cfd8978e715 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:18.733167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f4e95e1c-434a-4316-a95d-8cfd8978e715 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:18.925209 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f4e95e1c-434a-4316-a95d-8cfd8978e715 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:18.933021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f4e95e1c-434a-4316-a95d-8cfd8978e715 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.213798 Aug 30 02:05:18.933595 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 614/1195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:18 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:19.502984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8faf0600-050c-4926-8fd7-2f0b99ee13af tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:19.503593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8faf0600-050c-4926-8fd7-2f0b99ee13af tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:19.510914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8faf0600-050c-4926-8fd7-2f0b99ee13af tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:19.511389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8faf0600-050c-4926-8fd7-2f0b99ee13af tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:19.512030 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8faf0600-050c-4926-8fd7-2f0b99ee13af tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:19.512807 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8faf0600-050c-4926-8fd7-2f0b99ee13af tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:19.513326 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8faf0600-050c-4926-8fd7-2f0b99ee13af tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:19.513860 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8faf0600-050c-4926-8fd7-2f0b99ee13af tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:19.648442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8faf0600-050c-4926-8fd7-2f0b99ee13af tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:19.655989 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8faf0600-050c-4926-8fd7-2f0b99ee13af tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1363 microversion: 2.1 time: 0.156994 Aug 30 02:05:19.656573 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 582/1196] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:19 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:19.954603 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-39a9ec13-a46a-4b8e-8861-d935ead6b8b9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:19.955170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-39a9ec13-a46a-4b8e-8861-d935ead6b8b9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:19.961481 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-39a9ec13-a46a-4b8e-8861-d935ead6b8b9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:19.961955 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-39a9ec13-a46a-4b8e-8861-d935ead6b8b9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:19.962878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-39a9ec13-a46a-4b8e-8861-d935ead6b8b9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:19.963554 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-39a9ec13-a46a-4b8e-8861-d935ead6b8b9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:19.964001 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-39a9ec13-a46a-4b8e-8861-d935ead6b8b9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:19.964450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-39a9ec13-a46a-4b8e-8861-d935ead6b8b9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:20.095171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-39a9ec13-a46a-4b8e-8861-d935ead6b8b9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:20.102687 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-39a9ec13-a46a-4b8e-8861-d935ead6b8b9 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.152023 Aug 30 02:05:20.103887 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 615/1197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:19 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:20.677144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f7dcdf15-b373-4dff-90b9-087bef658024 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:20.677781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f7dcdf15-b373-4dff-90b9-087bef658024 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:20.685410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dcdf15-b373-4dff-90b9-087bef658024 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:20.685973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dcdf15-b373-4dff-90b9-087bef658024 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:20.686594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dcdf15-b373-4dff-90b9-087bef658024 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:20.687333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dcdf15-b373-4dff-90b9-087bef658024 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:20.687773 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dcdf15-b373-4dff-90b9-087bef658024 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:20.688213 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7dcdf15-b373-4dff-90b9-087bef658024 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:20.688991 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-e0ad4733-32e5-4705-9bd6-e901ba1b97ed req-d06b8081-1665-4cbe-afb9-1654ee65c25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fda211-de80-4455-9023-4d02d24482d9", "tag": "62afbf44-256a-4d44-b575-d190b4c34917"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:20.699542 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-e0ad4733-32e5-4705-9bd6-e901ba1b97ed req-d06b8081-1665-4cbe-afb9-1654ee65c25e service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:20.700566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-e0ad4733-32e5-4705-9bd6-e901ba1b97ed req-d06b8081-1665-4cbe-afb9-1654ee65c25e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:20.701446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-e0ad4733-32e5-4705-9bd6-e901ba1b97ed req-d06b8081-1665-4cbe-afb9-1654ee65c25e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:20.713129 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-e0ad4733-32e5-4705-9bd6-e901ba1b97ed req-d06b8081-1665-4cbe-afb9-1654ee65c25e service nova] Creating event network-changed:62afbf44-256a-4d44-b575-d190b4c34917 for instance e4fda211-de80-4455-9023-4d02d24482d9 on hv-cinder-81966 Aug 30 02:05:20.718309 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-e0ad4733-32e5-4705-9bd6-e901ba1b97ed req-d06b8081-1665-4cbe-afb9-1654ee65c25e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033003 Aug 30 02:05:20.719541 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 616/1198] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:05:21.012850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f7dcdf15-b373-4dff-90b9-087bef658024 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:21.021026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f7dcdf15-b373-4dff-90b9-087bef658024 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1363 microversion: 2.1 time: 0.347702 Aug 30 02:05:21.021592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 583/1199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:20 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:21.125301 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-85759b72-e8b7-4b65-8df9-da7bf86534cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:21.125993 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-85759b72-e8b7-4b65-8df9-da7bf86534cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:21.132127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85759b72-e8b7-4b65-8df9-da7bf86534cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:21.132657 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85759b72-e8b7-4b65-8df9-da7bf86534cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:21.133088 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85759b72-e8b7-4b65-8df9-da7bf86534cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:21.133781 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85759b72-e8b7-4b65-8df9-da7bf86534cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:21.134490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85759b72-e8b7-4b65-8df9-da7bf86534cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:21.134916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85759b72-e8b7-4b65-8df9-da7bf86534cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:21.312311 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-85759b72-e8b7-4b65-8df9-da7bf86534cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:21.320191 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-85759b72-e8b7-4b65-8df9-da7bf86534cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.199541 Aug 30 02:05:21.320790 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 617/1200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:21 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:22.041829 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2fb38ccc-7c76-48ae-86d3-98031247a90c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:22.042446 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2fb38ccc-7c76-48ae-86d3-98031247a90c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:22.048894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2fb38ccc-7c76-48ae-86d3-98031247a90c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:22.049314 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2fb38ccc-7c76-48ae-86d3-98031247a90c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:22.049749 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2fb38ccc-7c76-48ae-86d3-98031247a90c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:22.050448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2fb38ccc-7c76-48ae-86d3-98031247a90c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:22.050900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2fb38ccc-7c76-48ae-86d3-98031247a90c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:22.051323 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2fb38ccc-7c76-48ae-86d3-98031247a90c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:22.182096 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2fb38ccc-7c76-48ae-86d3-98031247a90c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:22.189579 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2fb38ccc-7c76-48ae-86d3-98031247a90c tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1363 microversion: 2.1 time: 0.152119 Aug 30 02:05:22.190169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 584/1201] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:22 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:22.340217 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e86e25a9-2a6e-45f8-9e47-c24ae3a36b54 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:22.340863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e86e25a9-2a6e-45f8-9e47-c24ae3a36b54 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:22.347893 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e86e25a9-2a6e-45f8-9e47-c24ae3a36b54 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:22.348413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e86e25a9-2a6e-45f8-9e47-c24ae3a36b54 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:22.348844 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e86e25a9-2a6e-45f8-9e47-c24ae3a36b54 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:22.349534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e86e25a9-2a6e-45f8-9e47-c24ae3a36b54 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:22.349981 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e86e25a9-2a6e-45f8-9e47-c24ae3a36b54 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:22.350395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e86e25a9-2a6e-45f8-9e47-c24ae3a36b54 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:22.554955 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e86e25a9-2a6e-45f8-9e47-c24ae3a36b54 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:22.565142 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e86e25a9-2a6e-45f8-9e47-c24ae3a36b54 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.229087 Aug 30 02:05:22.565877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 618/1202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:22 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:23.211314 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ed7d864e-c065-4a8c-bb02-29aa9b8a6ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:23.211915 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ed7d864e-c065-4a8c-bb02-29aa9b8a6ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:23.218341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed7d864e-c065-4a8c-bb02-29aa9b8a6ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:23.218819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed7d864e-c065-4a8c-bb02-29aa9b8a6ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:23.219248 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed7d864e-c065-4a8c-bb02-29aa9b8a6ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:23.219929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed7d864e-c065-4a8c-bb02-29aa9b8a6ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:23.220415 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed7d864e-c065-4a8c-bb02-29aa9b8a6ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:23.220834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ed7d864e-c065-4a8c-bb02-29aa9b8a6ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:23.589299 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c17598f5-78c7-4f1d-ba14-dc2f3a24362b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:23.590090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c17598f5-78c7-4f1d-ba14-dc2f3a24362b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:23.597413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c17598f5-78c7-4f1d-ba14-dc2f3a24362b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:23.597967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c17598f5-78c7-4f1d-ba14-dc2f3a24362b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:23.598474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c17598f5-78c7-4f1d-ba14-dc2f3a24362b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:23.599264 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c17598f5-78c7-4f1d-ba14-dc2f3a24362b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:23.599378 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ed7d864e-c065-4a8c-bb02-29aa9b8a6ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:23.599845 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c17598f5-78c7-4f1d-ba14-dc2f3a24362b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:23.600363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c17598f5-78c7-4f1d-ba14-dc2f3a24362b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:23.607511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ed7d864e-c065-4a8c-bb02-29aa9b8a6ea0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1363 microversion: 2.1 time: 0.400048 Aug 30 02:05:23.616274 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 585/1203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:23 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:23.794607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-dc415d00-a48d-48f3-8c65-cd1b3ee06f6f req-4883b545-ac72-4f00-8afd-541847422328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d175d1c1-24a5-488c-87b9-6de5c2b20479", "name": "network-vif-plugged", "status": "completed", "tag": "4b5a253a-9dd3-4c0d-a265-de8c1a9ebbed"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:23.807742 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dc415d00-a48d-48f3-8c65-cd1b3ee06f6f req-4883b545-ac72-4f00-8afd-541847422328 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:23.808817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dc415d00-a48d-48f3-8c65-cd1b3ee06f6f req-4883b545-ac72-4f00-8afd-541847422328 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:23.810587 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-dc415d00-a48d-48f3-8c65-cd1b3ee06f6f req-4883b545-ac72-4f00-8afd-541847422328 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:23.822599 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-dc415d00-a48d-48f3-8c65-cd1b3ee06f6f req-4883b545-ac72-4f00-8afd-541847422328 service nova] Creating event network-vif-plugged:4b5a253a-9dd3-4c0d-a265-de8c1a9ebbed for instance d175d1c1-24a5-488c-87b9-6de5c2b20479 on hv-cinder-81966 Aug 30 02:05:23.828202 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-dc415d00-a48d-48f3-8c65-cd1b3ee06f6f req-4883b545-ac72-4f00-8afd-541847422328 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037875 Aug 30 02:05:23.829287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 586/1204] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:24.038225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-c17598f5-78c7-4f1d-ba14-dc2f3a24362b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:24.048791 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c17598f5-78c7-4f1d-ba14-dc2f3a24362b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.466382 Aug 30 02:05:24.049400 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 619/1205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:23 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:24.629932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8bc12c60-2227-498a-bca8-7ca2532ba6e2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:24.630872 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8bc12c60-2227-498a-bca8-7ca2532ba6e2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:24.637700 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8bc12c60-2227-498a-bca8-7ca2532ba6e2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:24.638175 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8bc12c60-2227-498a-bca8-7ca2532ba6e2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:24.638606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8bc12c60-2227-498a-bca8-7ca2532ba6e2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:24.639634 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8bc12c60-2227-498a-bca8-7ca2532ba6e2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:24.640141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8bc12c60-2227-498a-bca8-7ca2532ba6e2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:24.640705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8bc12c60-2227-498a-bca8-7ca2532ba6e2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:24.772910 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8bc12c60-2227-498a-bca8-7ca2532ba6e2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:24.780825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8bc12c60-2227-498a-bca8-7ca2532ba6e2 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1363 microversion: 2.1 time: 0.155519 Aug 30 02:05:24.781391 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 587/1206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:24 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:25.069539 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-04a05d03-7daf-4820-80ca-fee65f0aeeef tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:25.070150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-04a05d03-7daf-4820-80ca-fee65f0aeeef tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:25.076616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04a05d03-7daf-4820-80ca-fee65f0aeeef tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:25.077196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04a05d03-7daf-4820-80ca-fee65f0aeeef tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:25.077803 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04a05d03-7daf-4820-80ca-fee65f0aeeef tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:25.081673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04a05d03-7daf-4820-80ca-fee65f0aeeef tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:25.081673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04a05d03-7daf-4820-80ca-fee65f0aeeef tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:25.081673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-04a05d03-7daf-4820-80ca-fee65f0aeeef tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:25.214522 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-04a05d03-7daf-4820-80ca-fee65f0aeeef tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:25.222242 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-04a05d03-7daf-4820-80ca-fee65f0aeeef tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.156617 Aug 30 02:05:25.222807 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 620/1207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:25 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:25.802244 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f8ad561b-e7f1-496d-a0c6-22d2ef9e37dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:25.803411 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f8ad561b-e7f1-496d-a0c6-22d2ef9e37dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:25.810093 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8ad561b-e7f1-496d-a0c6-22d2ef9e37dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:25.810794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8ad561b-e7f1-496d-a0c6-22d2ef9e37dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:25.811393 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8ad561b-e7f1-496d-a0c6-22d2ef9e37dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:25.812457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8ad561b-e7f1-496d-a0c6-22d2ef9e37dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:25.813097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8ad561b-e7f1-496d-a0c6-22d2ef9e37dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:25.813520 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f8ad561b-e7f1-496d-a0c6-22d2ef9e37dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:25.958056 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f8ad561b-e7f1-496d-a0c6-22d2ef9e37dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:25.966686 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f8ad561b-e7f1-496d-a0c6-22d2ef9e37dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1363 microversion: 2.1 time: 0.168131 Aug 30 02:05:25.967283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 588/1208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:25 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:26.243201 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-421ea491-fcff-4198-9815-59697e6c53cf tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:26.243956 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-421ea491-fcff-4198-9815-59697e6c53cf tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:26.250517 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-421ea491-fcff-4198-9815-59697e6c53cf tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:26.250996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-421ea491-fcff-4198-9815-59697e6c53cf tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:26.251683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-421ea491-fcff-4198-9815-59697e6c53cf tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:26.252399 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-421ea491-fcff-4198-9815-59697e6c53cf tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:26.252854 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-421ea491-fcff-4198-9815-59697e6c53cf tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:26.253279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-421ea491-fcff-4198-9815-59697e6c53cf tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:26.409394 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-421ea491-fcff-4198-9815-59697e6c53cf tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:26.421273 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-421ea491-fcff-4198-9815-59697e6c53cf tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1264 microversion: 2.1 time: 0.181976 Aug 30 02:05:26.421929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 621/1209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:26 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:26.986795 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-827bc257-e736-41d4-9118-16c8771fc7dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:26.987406 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-827bc257-e736-41d4-9118-16c8771fc7dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:26.994371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-827bc257-e736-41d4-9118-16c8771fc7dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:26.994856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-827bc257-e736-41d4-9118-16c8771fc7dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:26.995288 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-827bc257-e736-41d4-9118-16c8771fc7dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:26.995984 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-827bc257-e736-41d4-9118-16c8771fc7dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:26.996463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-827bc257-e736-41d4-9118-16c8771fc7dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:26.996889 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-827bc257-e736-41d4-9118-16c8771fc7dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.140803 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-827bc257-e736-41d4-9118-16c8771fc7dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:27.149552 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-827bc257-e736-41d4-9118-16c8771fc7dc tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1363 microversion: 2.1 time: 0.166446 Aug 30 02:05:27.150270 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 589/1210] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:26 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:27.406632 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c277cd4f-786a-4bd1-8645-bf4d16ca9937 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:27.408945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c277cd4f-786a-4bd1-8645-bf4d16ca9937 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:27.411970 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:27.412976 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=16 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:27.417683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c277cd4f-786a-4bd1-8645-bf4d16ca9937 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.418381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c277cd4f-786a-4bd1-8645-bf4d16ca9937 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.418978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c277cd4f-786a-4bd1-8645-bf4d16ca9937 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.419348 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c277cd4f-786a-4bd1-8645-bf4d16ca9937 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.419827 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c277cd4f-786a-4bd1-8645-bf4d16ca9937 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.420357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c277cd4f-786a-4bd1-8645-bf4d16ca9937 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.442122 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-77440eb3-8781-4317-b74e-fbaeb1524b1b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:27.443105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-77440eb3-8781-4317-b74e-fbaeb1524b1b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:27.449593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:27.451490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77440eb3-8781-4317-b74e-fbaeb1524b1b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.452166 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77440eb3-8781-4317-b74e-fbaeb1524b1b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.452894 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77440eb3-8781-4317-b74e-fbaeb1524b1b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.453838 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77440eb3-8781-4317-b74e-fbaeb1524b1b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.454472 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77440eb3-8781-4317-b74e-fbaeb1524b1b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.455076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-77440eb3-8781-4317-b74e-fbaeb1524b1b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.505297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c277cd4f-786a-4bd1-8645-bf4d16ca9937 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "POST /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/action" status: 202 len: 0 microversion: 2.1 time: 0.102350 Aug 30 02:05:27.506027 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 622/1211] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:05:27 2022] POST /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:05:27.515299 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-50b0e09f-cac7-4f89-b23f-9dadb1df84f7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:27.516086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-50b0e09f-cac7-4f89-b23f-9dadb1df84f7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:27.525128 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50b0e09f-cac7-4f89-b23f-9dadb1df84f7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.526400 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50b0e09f-cac7-4f89-b23f-9dadb1df84f7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.527011 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50b0e09f-cac7-4f89-b23f-9dadb1df84f7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.528578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50b0e09f-cac7-4f89-b23f-9dadb1df84f7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.529231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50b0e09f-cac7-4f89-b23f-9dadb1df84f7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.529961 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-50b0e09f-cac7-4f89-b23f-9dadb1df84f7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.606657 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-77440eb3-8781-4317-b74e-fbaeb1524b1b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:27.615156 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-77440eb3-8781-4317-b74e-fbaeb1524b1b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1451 microversion: 2.1 time: 0.177258 Aug 30 02:05:27.615706 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 590/1212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:27 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:27.635717 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0242307f-8026-4848-ba00-cceda43db19d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:27.636538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0242307f-8026-4848-ba00-cceda43db19d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:27.643563 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0242307f-8026-4848-ba00-cceda43db19d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.644351 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0242307f-8026-4848-ba00-cceda43db19d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.645040 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0242307f-8026-4848-ba00-cceda43db19d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.645975 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0242307f-8026-4848-ba00-cceda43db19d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.646502 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0242307f-8026-4848-ba00-cceda43db19d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.646994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0242307f-8026-4848-ba00-cceda43db19d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.771053 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-50b0e09f-cac7-4f89-b23f-9dadb1df84f7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:27.781445 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-50b0e09f-cac7-4f89-b23f-9dadb1df84f7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1751 microversion: 2.1 time: 0.270296 Aug 30 02:05:27.782586 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 623/1213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:27 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1751 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:27.834809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0242307f-8026-4848-ba00-cceda43db19d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:27.847109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0242307f-8026-4848-ba00-cceda43db19d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1451 microversion: 2.1 time: 0.214801 Aug 30 02:05:27.848112 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 591/1214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:27 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:27.866900 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-40a27778-2656-4be1-a65a-40c5505cdf22 req-9a6470d7-e49b-4c56-b36c-a9911aff7100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fda211-de80-4455-9023-4d02d24482d9", "name": "network-vif-plugged", "status": "completed", "tag": "62afbf44-256a-4d44-b575-d190b4c34917"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:27.879462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-40a27778-2656-4be1-a65a-40c5505cdf22 req-9a6470d7-e49b-4c56-b36c-a9911aff7100 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.880973 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-40a27778-2656-4be1-a65a-40c5505cdf22 req-9a6470d7-e49b-4c56-b36c-a9911aff7100 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.881645 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-40a27778-2656-4be1-a65a-40c5505cdf22 req-9a6470d7-e49b-4c56-b36c-a9911aff7100 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.899334 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-40a27778-2656-4be1-a65a-40c5505cdf22 req-9a6470d7-e49b-4c56-b36c-a9911aff7100 service nova] Creating event network-vif-plugged:62afbf44-256a-4d44-b575-d190b4c34917 for instance e4fda211-de80-4455-9023-4d02d24482d9 on hv-cinder-81966 Aug 30 02:05:27.906462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-40a27778-2656-4be1-a65a-40c5505cdf22 req-9a6470d7-e49b-4c56-b36c-a9911aff7100 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042470 Aug 30 02:05:27.908090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 624/1215] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:28.171302 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d47ea958-cb33-4202-90f9-c8f406e97838 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:28.172734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d47ea958-cb33-4202-90f9-c8f406e97838 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:28.180062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d47ea958-cb33-4202-90f9-c8f406e97838 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:28.180691 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d47ea958-cb33-4202-90f9-c8f406e97838 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:28.181663 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d47ea958-cb33-4202-90f9-c8f406e97838 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:28.182567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d47ea958-cb33-4202-90f9-c8f406e97838 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:28.183143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d47ea958-cb33-4202-90f9-c8f406e97838 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:28.184110 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d47ea958-cb33-4202-90f9-c8f406e97838 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:28.378697 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d47ea958-cb33-4202-90f9-c8f406e97838 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:28.387243 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d47ea958-cb33-4202-90f9-c8f406e97838 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1363 microversion: 2.1 time: 0.220087 Aug 30 02:05:28.388049 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 592/1216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:28 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:28.803454 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4859d656-b4c2-42b1-ac1a-d3869c98df4d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:28.804523 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4859d656-b4c2-42b1-ac1a-d3869c98df4d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:28.808842 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:28.812805 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4859d656-b4c2-42b1-ac1a-d3869c98df4d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:28.813289 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4859d656-b4c2-42b1-ac1a-d3869c98df4d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:28.813719 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4859d656-b4c2-42b1-ac1a-d3869c98df4d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:28.814671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4859d656-b4c2-42b1-ac1a-d3869c98df4d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:28.815125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4859d656-b4c2-42b1-ac1a-d3869c98df4d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:28.815546 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4859d656-b4c2-42b1-ac1a-d3869c98df4d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:28.986628 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4859d656-b4c2-42b1-ac1a-d3869c98df4d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:28.994800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4859d656-b4c2-42b1-ac1a-d3869c98df4d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1751 microversion: 2.1 time: 0.195497 Aug 30 02:05:28.995367 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 625/1217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:28 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:29.409571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bb0b8dd0-5383-4cc7-82ac-c9389571b40e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:29.410190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bb0b8dd0-5383-4cc7-82ac-c9389571b40e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:29.412522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:29.419590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb0b8dd0-5383-4cc7-82ac-c9389571b40e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:29.420207 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb0b8dd0-5383-4cc7-82ac-c9389571b40e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:29.420710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb0b8dd0-5383-4cc7-82ac-c9389571b40e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:29.421683 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb0b8dd0-5383-4cc7-82ac-c9389571b40e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:29.422368 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb0b8dd0-5383-4cc7-82ac-c9389571b40e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:29.422794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bb0b8dd0-5383-4cc7-82ac-c9389571b40e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:29.619192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bb0b8dd0-5383-4cc7-82ac-c9389571b40e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:29.627869 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bb0b8dd0-5383-4cc7-82ac-c9389571b40e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1363 microversion: 2.1 time: 0.222136 Aug 30 02:05:29.629233 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 593/1218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:29 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:29.668209 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-d7cbeb86-78ff-4753-a6bd-19b0a5d94733 req-237d88d3-bed6-4daf-b95e-9c17dadd935c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d175d1c1-24a5-488c-87b9-6de5c2b20479", "tag": "4b5a253a-9dd3-4c0d-a265-de8c1a9ebbed"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:29.677962 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d7cbeb86-78ff-4753-a6bd-19b0a5d94733 req-237d88d3-bed6-4daf-b95e-9c17dadd935c service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:29.678714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d7cbeb86-78ff-4753-a6bd-19b0a5d94733 req-237d88d3-bed6-4daf-b95e-9c17dadd935c service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:29.679140 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-d7cbeb86-78ff-4753-a6bd-19b0a5d94733 req-237d88d3-bed6-4daf-b95e-9c17dadd935c service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:29.697715 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1486402866", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:29.704673 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-d7cbeb86-78ff-4753-a6bd-19b0a5d94733 req-237d88d3-bed6-4daf-b95e-9c17dadd935c service nova] Creating event network-changed:4b5a253a-9dd3-4c0d-a265-de8c1a9ebbed for instance d175d1c1-24a5-488c-87b9-6de5c2b20479 on hv-cinder-81966 Aug 30 02:05:29.711414 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-d7cbeb86-78ff-4753-a6bd-19b0a5d94733 req-237d88d3-bed6-4daf-b95e-9c17dadd935c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047304 Aug 30 02:05:29.712850 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 626/1219] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:29.753926 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] validate_networks() for None {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:05:30.017416 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5f1bc47c-0bad-4eab-beee-7af869c8714e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:30.018184 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5f1bc47c-0bad-4eab-beee-7af869c8714e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:30.025503 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f1bc47c-0bad-4eab-beee-7af869c8714e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.026009 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f1bc47c-0bad-4eab-beee-7af869c8714e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.027096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f1bc47c-0bad-4eab-beee-7af869c8714e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:30.028131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f1bc47c-0bad-4eab-beee-7af869c8714e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.028617 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f1bc47c-0bad-4eab-beee-7af869c8714e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.029853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5f1bc47c-0bad-4eab-beee-7af869c8714e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:30.032180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:05:30.032632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:05:30.033128 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:05:30.033535 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:05:30.033939 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:05:30.046059 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.047126 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.047899 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:30.049292 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.049764 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.050347 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:30.069549 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Getting quotas for project 132faa65e64a4205922d82d962fc62d5. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:05:30.074736 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Getting quotas for user e58a9e6d9e4c437085f36d3135c16467 and project 132faa65e64a4205922d82d962fc62d5. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:05:30.089569 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:05:30.091893 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:05:30.145433 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b920edc5-af2f-47c9-9076-7c7e5700dea0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.451933 Aug 30 02:05:30.146078 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 594/1220] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 02:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 02:05:30.157976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8a61a08d-319c-4a20-beb0-358a22246f88 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:30.158596 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8a61a08d-319c-4a20-beb0-358a22246f88 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:30.238835 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5f1bc47c-0bad-4eab-beee-7af869c8714e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:30.245511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8a61a08d-319c-4a20-beb0-358a22246f88 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:30.247942 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5f1bc47c-0bad-4eab-beee-7af869c8714e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.235759 Aug 30 02:05:30.248870 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 627/1221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:30 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:30.252511 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8a61a08d-319c-4a20-beb0-358a22246f88 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1215 microversion: 2.1 time: 0.098998 Aug 30 02:05:30.253235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 595/1222] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:30 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:30.653850 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f1348b5f-78d9-48b5-82d1-29e57237bdec tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:30.654755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f1348b5f-78d9-48b5-82d1-29e57237bdec tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:30.663497 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f1348b5f-78d9-48b5-82d1-29e57237bdec tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.664959 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f1348b5f-78d9-48b5-82d1-29e57237bdec tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.665791 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f1348b5f-78d9-48b5-82d1-29e57237bdec tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:30.667480 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f1348b5f-78d9-48b5-82d1-29e57237bdec tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.668473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f1348b5f-78d9-48b5-82d1-29e57237bdec tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.669221 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f1348b5f-78d9-48b5-82d1-29e57237bdec tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:30.885663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f1348b5f-78d9-48b5-82d1-29e57237bdec tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:30.895161 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f1348b5f-78d9-48b5-82d1-29e57237bdec tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1549 microversion: 2.1 time: 0.245549 Aug 30 02:05:30.896086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 628/1223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:30 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1549 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:30.917941 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c9a8154c-4925-4d70-a13e-f5f03e63691a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:30.918441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c9a8154c-4925-4d70-a13e-f5f03e63691a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:30.935470 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a8154c-4925-4d70-a13e-f5f03e63691a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.936083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a8154c-4925-4d70-a13e-f5f03e63691a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.936624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a8154c-4925-4d70-a13e-f5f03e63691a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:30.937442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a8154c-4925-4d70-a13e-f5f03e63691a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.938079 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a8154c-4925-4d70-a13e-f5f03e63691a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.938507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a8154c-4925-4d70-a13e-f5f03e63691a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:31.024326 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c9a8154c-4925-4d70-a13e-f5f03e63691a tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110519 Aug 30 02:05:31.025256 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 596/1224] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 02:05:30 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:31.273821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7ad6a454-8fb5-4d75-abe8-a3b4673ca5dc tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:31.275468 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1a2740b6-953c-44db-a03c-5c84d0128ff1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:31.276109 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1a2740b6-953c-44db-a03c-5c84d0128ff1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:31.279886 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7ad6a454-8fb5-4d75-abe8-a3b4673ca5dc tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:31.282939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a2740b6-953c-44db-a03c-5c84d0128ff1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:31.283443 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a2740b6-953c-44db-a03c-5c84d0128ff1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:31.283889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a2740b6-953c-44db-a03c-5c84d0128ff1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:31.284854 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a2740b6-953c-44db-a03c-5c84d0128ff1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:31.285311 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a2740b6-953c-44db-a03c-5c84d0128ff1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:31.285892 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1a2740b6-953c-44db-a03c-5c84d0128ff1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:31.292437 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ad6a454-8fb5-4d75-abe8-a3b4673ca5dc tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:31.293144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ad6a454-8fb5-4d75-abe8-a3b4673ca5dc tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:31.293733 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ad6a454-8fb5-4d75-abe8-a3b4673ca5dc tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:31.294723 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ad6a454-8fb5-4d75-abe8-a3b4673ca5dc tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:31.295332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ad6a454-8fb5-4d75-abe8-a3b4673ca5dc tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:31.295900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7ad6a454-8fb5-4d75-abe8-a3b4673ca5dc tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:31.399909 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7ad6a454-8fb5-4d75-abe8-a3b4673ca5dc tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:31.408311 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7ad6a454-8fb5-4d75-abe8-a3b4673ca5dc tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1267 microversion: 2.1 time: 0.138126 Aug 30 02:05:31.420938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 597/1225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:31 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:31.462912 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1a2740b6-953c-44db-a03c-5c84d0128ff1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:31.471822 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1a2740b6-953c-44db-a03c-5c84d0128ff1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.205561 Aug 30 02:05:31.472803 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 629/1226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:31 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:32.263897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-4a57d377-485a-46ca-b7d7-cc6868304aca req-e28e471f-c495-455d-bedc-cbb665cdabfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fda211-de80-4455-9023-4d02d24482d9", "tag": "62afbf44-256a-4d44-b575-d190b4c34917"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:32.275545 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-4a57d377-485a-46ca-b7d7-cc6868304aca req-e28e471f-c495-455d-bedc-cbb665cdabfb service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.276152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-4a57d377-485a-46ca-b7d7-cc6868304aca req-e28e471f-c495-455d-bedc-cbb665cdabfb service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.276705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-4a57d377-485a-46ca-b7d7-cc6868304aca req-e28e471f-c495-455d-bedc-cbb665cdabfb service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.292100 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-4a57d377-485a-46ca-b7d7-cc6868304aca req-e28e471f-c495-455d-bedc-cbb665cdabfb service nova] Creating event network-changed:62afbf44-256a-4d44-b575-d190b4c34917 for instance e4fda211-de80-4455-9023-4d02d24482d9 on hv-cinder-81966 Aug 30 02:05:32.300344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-4a57d377-485a-46ca-b7d7-cc6868304aca req-e28e471f-c495-455d-bedc-cbb665cdabfb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040496 Aug 30 02:05:32.301294 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 598/1227] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:05:32.431271 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5435214b-a873-4c6b-95aa-c8a5665137fb tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:32.431850 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5435214b-a873-4c6b-95aa-c8a5665137fb tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:32.447611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5435214b-a873-4c6b-95aa-c8a5665137fb tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.448321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5435214b-a873-4c6b-95aa-c8a5665137fb tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.448945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5435214b-a873-4c6b-95aa-c8a5665137fb tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.449693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5435214b-a873-4c6b-95aa-c8a5665137fb tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.450337 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5435214b-a873-4c6b-95aa-c8a5665137fb tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.450763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5435214b-a873-4c6b-95aa-c8a5665137fb tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.466401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:32.496182 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5c632ce3-fb0f-41b6-ab83-b118487ef8a6 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:32.497270 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5c632ce3-fb0f-41b6-ab83-b118487ef8a6 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:32.503706 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c632ce3-fb0f-41b6-ab83-b118487ef8a6 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.504196 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c632ce3-fb0f-41b6-ab83-b118487ef8a6 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.504684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c632ce3-fb0f-41b6-ab83-b118487ef8a6 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.505392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c632ce3-fb0f-41b6-ab83-b118487ef8a6 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.505841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c632ce3-fb0f-41b6-ab83-b118487ef8a6 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.506443 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5c632ce3-fb0f-41b6-ab83-b118487ef8a6 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.685383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5c632ce3-fb0f-41b6-ab83-b118487ef8a6 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:32.699343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5c632ce3-fb0f-41b6-ab83-b118487ef8a6 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.209100 Aug 30 02:05:32.701605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 599/1228] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:32 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:32.824619 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5435214b-a873-4c6b-95aa-c8a5665137fb tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:32.832856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5435214b-a873-4c6b-95aa-c8a5665137fb tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1315 microversion: 2.1 time: 0.406187 Aug 30 02:05:32.833415 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 630/1229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:32 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:33.722031 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e2d741ef-5056-45f1-9ba1-8cbd91873b22 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:33.722720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e2d741ef-5056-45f1-9ba1-8cbd91873b22 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:33.730391 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2d741ef-5056-45f1-9ba1-8cbd91873b22 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.730595 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2d741ef-5056-45f1-9ba1-8cbd91873b22 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.731123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2d741ef-5056-45f1-9ba1-8cbd91873b22 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.732171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2d741ef-5056-45f1-9ba1-8cbd91873b22 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.732319 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2d741ef-5056-45f1-9ba1-8cbd91873b22 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.732720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e2d741ef-5056-45f1-9ba1-8cbd91873b22 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.837532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-58599ba4-82fb-4793-b1bf-4c8f13e820f0 req-f7b32f50-0e33-42da-ad9f-81f08ab8586b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcdb746a-8d40-407b-adf7-aef70719558f", "tag": "6f7837dc-e4f2-460d-bcf0-7e921c613bd6"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:33.850158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-58599ba4-82fb-4793-b1bf-4c8f13e820f0 req-f7b32f50-0e33-42da-ad9f-81f08ab8586b service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.850906 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-58599ba4-82fb-4793-b1bf-4c8f13e820f0 req-f7b32f50-0e33-42da-ad9f-81f08ab8586b service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.851494 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-58599ba4-82fb-4793-b1bf-4c8f13e820f0 req-f7b32f50-0e33-42da-ad9f-81f08ab8586b service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.864310 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-58599ba4-82fb-4793-b1bf-4c8f13e820f0 req-f7b32f50-0e33-42da-ad9f-81f08ab8586b service nova] Creating event network-changed:6f7837dc-e4f2-460d-bcf0-7e921c613bd6 for instance bcdb746a-8d40-407b-adf7-aef70719558f on hv-cinder-81966 Aug 30 02:05:33.869127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-58599ba4-82fb-4793-b1bf-4c8f13e820f0 req-f7b32f50-0e33-42da-ad9f-81f08ab8586b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035765 Aug 30 02:05:33.869702 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 631/1230] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:33.874826 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-67a9ea74-a4d7-4323-b2e3-38dea1dd57a4 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:33.875602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-67a9ea74-a4d7-4323-b2e3-38dea1dd57a4 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:33.882963 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-e2d741ef-5056-45f1-9ba1-8cbd91873b22 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:33.883256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67a9ea74-a4d7-4323-b2e3-38dea1dd57a4 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.884715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67a9ea74-a4d7-4323-b2e3-38dea1dd57a4 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.885325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67a9ea74-a4d7-4323-b2e3-38dea1dd57a4 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.886184 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67a9ea74-a4d7-4323-b2e3-38dea1dd57a4 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.886841 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67a9ea74-a4d7-4323-b2e3-38dea1dd57a4 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.887446 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-67a9ea74-a4d7-4323-b2e3-38dea1dd57a4 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.898553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e2d741ef-5056-45f1-9ba1-8cbd91873b22 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.174245 Aug 30 02:05:33.899494 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 600/1231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:33 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:34.111091 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-67a9ea74-a4d7-4323-b2e3-38dea1dd57a4 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:34.118633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-67a9ea74-a4d7-4323-b2e3-38dea1dd57a4 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1315 microversion: 2.1 time: 0.247663 Aug 30 02:05:34.119200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 632/1232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:33 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:34.921213 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-13cd5564-09df-4a36-aa92-a75008c60fa7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:34.921809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-13cd5564-09df-4a36-aa92-a75008c60fa7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:34.928228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13cd5564-09df-4a36-aa92-a75008c60fa7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:34.928727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13cd5564-09df-4a36-aa92-a75008c60fa7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:34.929154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13cd5564-09df-4a36-aa92-a75008c60fa7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:34.929833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13cd5564-09df-4a36-aa92-a75008c60fa7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:34.930275 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13cd5564-09df-4a36-aa92-a75008c60fa7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:34.930727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-13cd5564-09df-4a36-aa92-a75008c60fa7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:34.933876 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=100 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:35.075344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-13cd5564-09df-4a36-aa92-a75008c60fa7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:35.083447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-13cd5564-09df-4a36-aa92-a75008c60fa7 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.166134 Aug 30 02:05:35.084002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 601/1233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:34 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:35.139294 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-52804909-27af-4648-94eb-ed98f8fbcaf9 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:35.139923 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-52804909-27af-4648-94eb-ed98f8fbcaf9 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:35.146360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52804909-27af-4648-94eb-ed98f8fbcaf9 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:35.146836 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52804909-27af-4648-94eb-ed98f8fbcaf9 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:35.147261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52804909-27af-4648-94eb-ed98f8fbcaf9 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:35.147937 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52804909-27af-4648-94eb-ed98f8fbcaf9 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:35.148407 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52804909-27af-4648-94eb-ed98f8fbcaf9 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:35.148825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-52804909-27af-4648-94eb-ed98f8fbcaf9 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:35.280061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-52804909-27af-4648-94eb-ed98f8fbcaf9 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:35.287842 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-52804909-27af-4648-94eb-ed98f8fbcaf9 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1315 microversion: 2.1 time: 0.152366 Aug 30 02:05:35.288422 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 633/1234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:35 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:36.105470 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9ccbbfe1-ec86-4674-968c-59b824ba424b tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:36.106101 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9ccbbfe1-ec86-4674-968c-59b824ba424b tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:36.112495 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ccbbfe1-ec86-4674-968c-59b824ba424b tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:36.112969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ccbbfe1-ec86-4674-968c-59b824ba424b tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:36.113392 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ccbbfe1-ec86-4674-968c-59b824ba424b tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:36.114075 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ccbbfe1-ec86-4674-968c-59b824ba424b tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:36.114516 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ccbbfe1-ec86-4674-968c-59b824ba424b tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:36.114930 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9ccbbfe1-ec86-4674-968c-59b824ba424b tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:36.256179 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9ccbbfe1-ec86-4674-968c-59b824ba424b tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:36.264564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9ccbbfe1-ec86-4674-968c-59b824ba424b tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.163474 Aug 30 02:05:36.265111 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 602/1235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:36 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:36.309487 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9bf9d8cb-8393-4c15-be25-5fd6223c68f7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:36.310105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9bf9d8cb-8393-4c15-be25-5fd6223c68f7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:36.316598 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9bf9d8cb-8393-4c15-be25-5fd6223c68f7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:36.317101 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9bf9d8cb-8393-4c15-be25-5fd6223c68f7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:36.317521 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9bf9d8cb-8393-4c15-be25-5fd6223c68f7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:36.318211 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9bf9d8cb-8393-4c15-be25-5fd6223c68f7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:36.318668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9bf9d8cb-8393-4c15-be25-5fd6223c68f7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:36.319084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9bf9d8cb-8393-4c15-be25-5fd6223c68f7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:36.444738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9bf9d8cb-8393-4c15-be25-5fd6223c68f7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:36.452176 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9bf9d8cb-8393-4c15-be25-5fd6223c68f7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1315 microversion: 2.1 time: 0.147101 Aug 30 02:05:36.452753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 634/1236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:36 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:37.285596 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-21eb8fba-72bc-42a6-98db-3b7c8f3dd351 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:37.286262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-21eb8fba-72bc-42a6-98db-3b7c8f3dd351 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:37.292897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21eb8fba-72bc-42a6-98db-3b7c8f3dd351 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.293383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21eb8fba-72bc-42a6-98db-3b7c8f3dd351 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.293818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21eb8fba-72bc-42a6-98db-3b7c8f3dd351 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.294514 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21eb8fba-72bc-42a6-98db-3b7c8f3dd351 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.294972 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21eb8fba-72bc-42a6-98db-3b7c8f3dd351 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.295425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21eb8fba-72bc-42a6-98db-3b7c8f3dd351 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.448580 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-21eb8fba-72bc-42a6-98db-3b7c8f3dd351 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:37.456866 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-21eb8fba-72bc-42a6-98db-3b7c8f3dd351 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.175250 Aug 30 02:05:37.457425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 603/1237] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:37 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:37.473144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-512d8a71-c5d9-4732-be21-39b08272deb7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:37.473757 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-512d8a71-c5d9-4732-be21-39b08272deb7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:37.480968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-512d8a71-c5d9-4732-be21-39b08272deb7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.481454 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-512d8a71-c5d9-4732-be21-39b08272deb7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.481893 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-512d8a71-c5d9-4732-be21-39b08272deb7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.483433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-512d8a71-c5d9-4732-be21-39b08272deb7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.483908 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-512d8a71-c5d9-4732-be21-39b08272deb7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.484381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-512d8a71-c5d9-4732-be21-39b08272deb7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.686856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-512d8a71-c5d9-4732-be21-39b08272deb7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:37.694373 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-512d8a71-c5d9-4732-be21-39b08272deb7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1315 microversion: 2.1 time: 0.225109 Aug 30 02:05:37.694937 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 635/1238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:37 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:38.478265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-02da7157-3bef-4cfa-bc7f-952c1ef37643 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:38.478821 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-02da7157-3bef-4cfa-bc7f-952c1ef37643 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:38.485320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02da7157-3bef-4cfa-bc7f-952c1ef37643 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.485795 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02da7157-3bef-4cfa-bc7f-952c1ef37643 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.486220 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02da7157-3bef-4cfa-bc7f-952c1ef37643 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.486910 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02da7157-3bef-4cfa-bc7f-952c1ef37643 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.487354 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02da7157-3bef-4cfa-bc7f-952c1ef37643 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.487774 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-02da7157-3bef-4cfa-bc7f-952c1ef37643 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.628531 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-02da7157-3bef-4cfa-bc7f-952c1ef37643 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:38.636885 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-02da7157-3bef-4cfa-bc7f-952c1ef37643 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.163078 Aug 30 02:05:38.637447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 604/1239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:38 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:38.717295 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6646b263-5319-45d9-a043-4d2da85ba108 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:38.717899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6646b263-5319-45d9-a043-4d2da85ba108 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:38.724529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6646b263-5319-45d9-a043-4d2da85ba108 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.725006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6646b263-5319-45d9-a043-4d2da85ba108 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.725430 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6646b263-5319-45d9-a043-4d2da85ba108 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.726107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6646b263-5319-45d9-a043-4d2da85ba108 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.726551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6646b263-5319-45d9-a043-4d2da85ba108 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.726972 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6646b263-5319-45d9-a043-4d2da85ba108 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.857066 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-6646b263-5319-45d9-a043-4d2da85ba108 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:38.864590 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6646b263-5319-45d9-a043-4d2da85ba108 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1315 microversion: 2.1 time: 0.151098 Aug 30 02:05:38.865144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 636/1240] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:38 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:39.657330 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3830800e-8e87-4766-ab28-63373af569fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:39.658037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3830800e-8e87-4766-ab28-63373af569fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:39.665856 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3830800e-8e87-4766-ab28-63373af569fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:39.666334 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3830800e-8e87-4766-ab28-63373af569fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:39.666760 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3830800e-8e87-4766-ab28-63373af569fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:39.667447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3830800e-8e87-4766-ab28-63373af569fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:39.667897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3830800e-8e87-4766-ab28-63373af569fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:39.668332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3830800e-8e87-4766-ab28-63373af569fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:39.822182 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3830800e-8e87-4766-ab28-63373af569fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:39.830535 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3830800e-8e87-4766-ab28-63373af569fc tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.177042 Aug 30 02:05:39.831096 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 605/1241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:39 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:39.855735 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-084aca16-429f-4c7c-aaad-574a3240d4f2 req-02179f3c-9856-4ffc-aaa7-55a8887a2a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcdb746a-8d40-407b-adf7-aef70719558f", "name": "network-vif-plugged", "status": "completed", "tag": "6f7837dc-e4f2-460d-bcf0-7e921c613bd6"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:39.865862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-084aca16-429f-4c7c-aaad-574a3240d4f2 req-02179f3c-9856-4ffc-aaa7-55a8887a2a3d service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:39.866609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-084aca16-429f-4c7c-aaad-574a3240d4f2 req-02179f3c-9856-4ffc-aaa7-55a8887a2a3d service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:39.867044 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-084aca16-429f-4c7c-aaad-574a3240d4f2 req-02179f3c-9856-4ffc-aaa7-55a8887a2a3d service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:39.879014 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-084aca16-429f-4c7c-aaad-574a3240d4f2 req-02179f3c-9856-4ffc-aaa7-55a8887a2a3d service nova] Creating event network-vif-plugged:6f7837dc-e4f2-460d-bcf0-7e921c613bd6 for instance bcdb746a-8d40-407b-adf7-aef70719558f on hv-cinder-81966 Aug 30 02:05:39.884417 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-084aca16-429f-4c7c-aaad-574a3240d4f2 req-02179f3c-9856-4ffc-aaa7-55a8887a2a3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032931 Aug 30 02:05:39.885482 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 637/1242] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:05:39.891582 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-99aa362d-6ed2-4696-9f77-29ac53820af0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:39.892344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-99aa362d-6ed2-4696-9f77-29ac53820af0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:39.901576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99aa362d-6ed2-4696-9f77-29ac53820af0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:39.902304 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99aa362d-6ed2-4696-9f77-29ac53820af0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:39.902736 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99aa362d-6ed2-4696-9f77-29ac53820af0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:39.903449 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99aa362d-6ed2-4696-9f77-29ac53820af0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:39.903899 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99aa362d-6ed2-4696-9f77-29ac53820af0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:39.904544 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-99aa362d-6ed2-4696-9f77-29ac53820af0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:40.041506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-99aa362d-6ed2-4696-9f77-29ac53820af0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:40.049801 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-99aa362d-6ed2-4696-9f77-29ac53820af0 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1315 microversion: 2.1 time: 0.168443 Aug 30 02:05:40.050955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 606/1243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:39 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:40.851683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ceeb971d-f41d-46ce-ad91-ed218a83efaa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:40.852434 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ceeb971d-f41d-46ce-ad91-ed218a83efaa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:40.858640 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ceeb971d-f41d-46ce-ad91-ed218a83efaa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:40.859226 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ceeb971d-f41d-46ce-ad91-ed218a83efaa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:40.859535 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ceeb971d-f41d-46ce-ad91-ed218a83efaa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:40.860223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ceeb971d-f41d-46ce-ad91-ed218a83efaa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:40.860700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ceeb971d-f41d-46ce-ad91-ed218a83efaa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:40.861122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ceeb971d-f41d-46ce-ad91-ed218a83efaa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:41.006816 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ceeb971d-f41d-46ce-ad91-ed218a83efaa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:41.015804 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ceeb971d-f41d-46ce-ad91-ed218a83efaa tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.168662 Aug 30 02:05:41.016380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 638/1244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:40 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:41.072087 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-78177a8d-8b71-42ad-8c6b-d61d65f05011 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:41.072534 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-78177a8d-8b71-42ad-8c6b-d61d65f05011 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:41.074186 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:41.078767 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=8 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:41.084968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-78177a8d-8b71-42ad-8c6b-d61d65f05011 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:41.085453 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-78177a8d-8b71-42ad-8c6b-d61d65f05011 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:41.085882 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-78177a8d-8b71-42ad-8c6b-d61d65f05011 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:41.086577 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-78177a8d-8b71-42ad-8c6b-d61d65f05011 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:41.087108 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-78177a8d-8b71-42ad-8c6b-d61d65f05011 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:41.087527 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-78177a8d-8b71-42ad-8c6b-d61d65f05011 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:41.213807 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-78177a8d-8b71-42ad-8c6b-d61d65f05011 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:41.221310 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-78177a8d-8b71-42ad-8c6b-d61d65f05011 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1315 microversion: 2.1 time: 0.154444 Aug 30 02:05:41.221869 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 607/1245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:41 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:42.036817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5ea6ccbf-32da-449a-9df3-1b5a77a01653 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:42.037432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5ea6ccbf-32da-449a-9df3-1b5a77a01653 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:42.044487 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ea6ccbf-32da-449a-9df3-1b5a77a01653 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.044968 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ea6ccbf-32da-449a-9df3-1b5a77a01653 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.045400 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ea6ccbf-32da-449a-9df3-1b5a77a01653 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.046084 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ea6ccbf-32da-449a-9df3-1b5a77a01653 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.046533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ea6ccbf-32da-449a-9df3-1b5a77a01653 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.046952 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ea6ccbf-32da-449a-9df3-1b5a77a01653 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.194383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ea6ccbf-32da-449a-9df3-1b5a77a01653 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:42.202474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5ea6ccbf-32da-449a-9df3-1b5a77a01653 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.169551 Aug 30 02:05:42.203024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 639/1246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:42 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:42.241071 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4f1b596e-d341-476e-8f51-ec7a7bd29645 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:42.241677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4f1b596e-d341-476e-8f51-ec7a7bd29645 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:42.248612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f1b596e-d341-476e-8f51-ec7a7bd29645 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.249088 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f1b596e-d341-476e-8f51-ec7a7bd29645 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.249514 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f1b596e-d341-476e-8f51-ec7a7bd29645 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.250194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f1b596e-d341-476e-8f51-ec7a7bd29645 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.250639 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f1b596e-d341-476e-8f51-ec7a7bd29645 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.251059 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4f1b596e-d341-476e-8f51-ec7a7bd29645 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.381165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4f1b596e-d341-476e-8f51-ec7a7bd29645 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:42.389081 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4f1b596e-d341-476e-8f51-ec7a7bd29645 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1464 microversion: 2.1 time: 0.151869 Aug 30 02:05:42.389652 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 608/1247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:42 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:42.433112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-77cba00a-5d4d-4baf-80af-9f0f53c90067 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:42.433610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-77cba00a-5d4d-4baf-80af-9f0f53c90067 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:42.439538 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-77cba00a-5d4d-4baf-80af-9f0f53c90067 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.440020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-77cba00a-5d4d-4baf-80af-9f0f53c90067 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.440492 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-77cba00a-5d4d-4baf-80af-9f0f53c90067 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.441180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-77cba00a-5d4d-4baf-80af-9f0f53c90067 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.441633 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-77cba00a-5d4d-4baf-80af-9f0f53c90067 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.442054 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-77cba00a-5d4d-4baf-80af-9f0f53c90067 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.466832 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-77cba00a-5d4d-4baf-80af-9f0f53c90067 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Going to try to terminate instance {{(pid=120391) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:05:42.543377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-77cba00a-5d4d-4baf-80af-9f0f53c90067 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 204 len: 0 microversion: 2.1 time: 0.114239 Aug 30 02:05:42.543953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 640/1248] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:05:42 2022] DELETE /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:05:42.552182 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-71ca401e-9741-477b-8f16-6d8a1a0827c7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:42.552827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-71ca401e-9741-477b-8f16-6d8a1a0827c7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:42.558710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71ca401e-9741-477b-8f16-6d8a1a0827c7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.559191 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71ca401e-9741-477b-8f16-6d8a1a0827c7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.559625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71ca401e-9741-477b-8f16-6d8a1a0827c7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.560342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71ca401e-9741-477b-8f16-6d8a1a0827c7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.560795 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71ca401e-9741-477b-8f16-6d8a1a0827c7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.561218 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71ca401e-9741-477b-8f16-6d8a1a0827c7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.685296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-71ca401e-9741-477b-8f16-6d8a1a0827c7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:42.692951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-71ca401e-9741-477b-8f16-6d8a1a0827c7 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1470 microversion: 2.1 time: 0.144597 Aug 30 02:05:42.693506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 609/1249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:42 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1470 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:43.223720 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-825547e2-fdb3-4888-96e8-422d9c3a64f5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:43.224474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-825547e2-fdb3-4888-96e8-422d9c3a64f5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:43.230746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-825547e2-fdb3-4888-96e8-422d9c3a64f5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:43.231218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-825547e2-fdb3-4888-96e8-422d9c3a64f5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:43.231643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-825547e2-fdb3-4888-96e8-422d9c3a64f5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:43.232355 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-825547e2-fdb3-4888-96e8-422d9c3a64f5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:43.232800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-825547e2-fdb3-4888-96e8-422d9c3a64f5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:43.233216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-825547e2-fdb3-4888-96e8-422d9c3a64f5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:43.375767 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-825547e2-fdb3-4888-96e8-422d9c3a64f5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:43.384841 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-825547e2-fdb3-4888-96e8-422d9c3a64f5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.164508 Aug 30 02:05:43.385401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 641/1250] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:43 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:43.714493 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-47bc01bc-cf47-402f-b373-70f643d6c1ae tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:43.715037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-47bc01bc-cf47-402f-b373-70f643d6c1ae tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:43.721391 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47bc01bc-cf47-402f-b373-70f643d6c1ae tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:43.721866 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47bc01bc-cf47-402f-b373-70f643d6c1ae tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:43.722296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47bc01bc-cf47-402f-b373-70f643d6c1ae tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:43.722980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47bc01bc-cf47-402f-b373-70f643d6c1ae tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:43.723432 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47bc01bc-cf47-402f-b373-70f643d6c1ae tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:43.723845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47bc01bc-cf47-402f-b373-70f643d6c1ae tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:43.851786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-47bc01bc-cf47-402f-b373-70f643d6c1ae tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:43.859934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-47bc01bc-cf47-402f-b373-70f643d6c1ae tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1470 microversion: 2.1 time: 0.149465 Aug 30 02:05:43.860545 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 610/1251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:43 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:44.406047 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0710a4d0-7dce-4948-85ec-ff7fd54f48e4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:44.406661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0710a4d0-7dce-4948-85ec-ff7fd54f48e4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:44.413111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710a4d0-7dce-4948-85ec-ff7fd54f48e4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:44.413584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710a4d0-7dce-4948-85ec-ff7fd54f48e4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:44.414021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710a4d0-7dce-4948-85ec-ff7fd54f48e4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:44.414707 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710a4d0-7dce-4948-85ec-ff7fd54f48e4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:44.415656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710a4d0-7dce-4948-85ec-ff7fd54f48e4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:44.416079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0710a4d0-7dce-4948-85ec-ff7fd54f48e4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:44.553800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0710a4d0-7dce-4948-85ec-ff7fd54f48e4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:44.562566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0710a4d0-7dce-4948-85ec-ff7fd54f48e4 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1756 microversion: 2.1 time: 0.160272 Aug 30 02:05:44.563132 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 642/1252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:44 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:44.881805 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-71eb861d-2461-4ee7-b350-8463f5a14c0a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:44.882350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-71eb861d-2461-4ee7-b350-8463f5a14c0a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:44.889022 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71eb861d-2461-4ee7-b350-8463f5a14c0a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:44.889506 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71eb861d-2461-4ee7-b350-8463f5a14c0a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:44.889937 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71eb861d-2461-4ee7-b350-8463f5a14c0a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:44.890617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71eb861d-2461-4ee7-b350-8463f5a14c0a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:44.891064 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71eb861d-2461-4ee7-b350-8463f5a14c0a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:44.891483 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-71eb861d-2461-4ee7-b350-8463f5a14c0a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:45.023393 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-71eb861d-2461-4ee7-b350-8463f5a14c0a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:45.030983 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-71eb861d-2461-4ee7-b350-8463f5a14c0a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1470 microversion: 2.1 time: 0.153168 Aug 30 02:05:45.031537 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 611/1253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:44 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:45.583466 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-30086f36-25e7-4e5d-a43a-63e77d7eb479 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:45.584009 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-30086f36-25e7-4e5d-a43a-63e77d7eb479 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:45.590868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30086f36-25e7-4e5d-a43a-63e77d7eb479 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:45.591340 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30086f36-25e7-4e5d-a43a-63e77d7eb479 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:45.591767 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30086f36-25e7-4e5d-a43a-63e77d7eb479 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:45.592468 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30086f36-25e7-4e5d-a43a-63e77d7eb479 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:45.592916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30086f36-25e7-4e5d-a43a-63e77d7eb479 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:45.593329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-30086f36-25e7-4e5d-a43a-63e77d7eb479 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:45.738695 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-30086f36-25e7-4e5d-a43a-63e77d7eb479 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:45.748198 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-30086f36-25e7-4e5d-a43a-63e77d7eb479 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1759 microversion: 2.1 time: 0.167667 Aug 30 02:05:45.748198 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 643/1254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:45 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:46.052133 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-290025e3-defe-48c9-bed8-1fd8d74a9f9d tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:46.052777 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-290025e3-defe-48c9-bed8-1fd8d74a9f9d tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:46.058935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-290025e3-defe-48c9-bed8-1fd8d74a9f9d tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:46.059420 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-290025e3-defe-48c9-bed8-1fd8d74a9f9d tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:46.059848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-290025e3-defe-48c9-bed8-1fd8d74a9f9d tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:46.060564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-290025e3-defe-48c9-bed8-1fd8d74a9f9d tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:46.061097 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-290025e3-defe-48c9-bed8-1fd8d74a9f9d tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:46.061432 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-290025e3-defe-48c9-bed8-1fd8d74a9f9d tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:46.193930 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-290025e3-defe-48c9-bed8-1fd8d74a9f9d tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:46.201660 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-290025e3-defe-48c9-bed8-1fd8d74a9f9d tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1470 microversion: 2.1 time: 0.153339 Aug 30 02:05:46.202304 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 612/1255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:46 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:46.524997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-0828b461-41b9-4e27-b860-8e94a1a1d79a req-fc214210-056c-4066-93dd-0fae337021e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcdb746a-8d40-407b-adf7-aef70719558f", "name": "network-vif-deleted", "tag": "6f7837dc-e4f2-460d-bcf0-7e921c613bd6"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:46.534871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-0828b461-41b9-4e27-b860-8e94a1a1d79a req-fc214210-056c-4066-93dd-0fae337021e5 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:46.535354 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-0828b461-41b9-4e27-b860-8e94a1a1d79a req-fc214210-056c-4066-93dd-0fae337021e5 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:46.535778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-0828b461-41b9-4e27-b860-8e94a1a1d79a req-fc214210-056c-4066-93dd-0fae337021e5 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:46.547622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-0828b461-41b9-4e27-b860-8e94a1a1d79a req-fc214210-056c-4066-93dd-0fae337021e5 service nova] Creating event network-vif-deleted:6f7837dc-e4f2-460d-bcf0-7e921c613bd6 for instance bcdb746a-8d40-407b-adf7-aef70719558f on hv-cinder-81966 Aug 30 02:05:46.552447 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-0828b461-41b9-4e27-b860-8e94a1a1d79a req-fc214210-056c-4066-93dd-0fae337021e5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031055 Aug 30 02:05:46.556508 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 644/1256] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:47.223819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:47.224468 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:47.231557 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:47.232043 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:47.232501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:47.233198 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:47.233648 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:47.234070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:47.267453 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:47.267934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:47.268399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:47.268848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lazy-loading 'fault' on Instance uuid bcdb746a-8d40-407b-adf7-aef70719558f {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:05:47.316665 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58a9e6d9e4c437085f36d3135c16467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132faa65e64a4205922d82d962fc62d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:47.325647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-59e6749e-34cb-4bf7-acfd-1c16270aa44a tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 200 len: 1305 microversion: 2.1 time: 0.106067 Aug 30 02:05:47.326221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 613/1257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:47 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:48.347107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:48.348444 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] [instance: bcdb746a-8d40-407b-adf7-aef70719558f] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:48.355234 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:48.355709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:48.356138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:48.357037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:48.357489 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:48.357915 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:48.371560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] HTTP exception thrown: Instance bcdb746a-8d40-407b-adf7-aef70719558f could not be found. Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Request method failure captured: Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f HTTP/1.1 Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDXBnL9zhoipbG5OfN3ZFdRhmErUlxIw_RwCHL6bVD8wAPMrtrxzsXq3_YJ4eou7IwruNlF_upjqRap4xdXrmWbvSdM9H8Elp7UBXZG3149sTGAGhgs0GhCYLtWH3ia5Gcp4g-jQxkKjQPFb7O9hEhoreL5C8PvKWyix0IcUGCEOl_Pk Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 132faa65e64a4205922d82d962fc62d5 Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesNegativeTest-1795975896 Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:05:48.373212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/132faa65e64a4205922d82d962fc62d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/132faa65e64a4205922d82d962fc62d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/132faa65e64a4205922d82d962fc62d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_132faa65e64a4205922d82d962fc62d5"}]}] Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesNegativeTest-1795975896 Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 132faa65e64a4205922d82d962fc62d5 Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesNegativeTest-1795975896 Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesNegativeTest-1795975896-project Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: e58a9e6d9e4c437085f36d3135c16467 Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesNegativeTest-1795975896-project Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance bcdb746a-8d40-407b-adf7-aef70719558f could not be found. Aug 30 02:05:48.374779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': 'bcdb746a-8d40-407b-adf7-aef70719558f'} Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcdb746a-8d40-407b-adf7-aef70719558f could not be found. Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:05:48.375597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcdb746a-8d40-407b-adf7-aef70719558f could not be found. Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcdb746a-8d40-407b-adf7-aef70719558f could not be found. Aug 30 02:05:48.376955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:05:48.378125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] Returning 404 to user: Instance bcdb746a-8d40-407b-adf7-aef70719558f could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:05:48.378125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ec6767d6-9415-4cb1-b331-8f7d3cecc937 tempest-VolumesNegativeTest-1795975896 tempest-VolumesNegativeTest-1795975896-project] 10.222.0.50 "GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f" status: 404 len: 111 microversion: 2.1 time: 0.031325 Aug 30 02:05:48.378125 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 614/1258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:48 2022] GET /compute/v2.1/servers/bcdb746a-8d40-407b-adf7-aef70719558f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:05:48.412899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f3e041b7-ac6d-4154-b6f6-31294288dc69 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:48.413488 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f3e041b7-ac6d-4154-b6f6-31294288dc69 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:48.420000 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f3e041b7-ac6d-4154-b6f6-31294288dc69 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:48.420512 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f3e041b7-ac6d-4154-b6f6-31294288dc69 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:48.420947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f3e041b7-ac6d-4154-b6f6-31294288dc69 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:48.421627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f3e041b7-ac6d-4154-b6f6-31294288dc69 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:48.422077 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f3e041b7-ac6d-4154-b6f6-31294288dc69 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:48.422494 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f3e041b7-ac6d-4154-b6f6-31294288dc69 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:48.446581 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f3e041b7-ac6d-4154-b6f6-31294288dc69 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/ips" status: 200 len: 153 microversion: 2.20 time: 0.227118 Aug 30 02:05:48.447262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 645/1259] 10.222.0.50 () {60 vars in 1289 bytes} [Tue Aug 30 02:05:48 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/ips => generated 153 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:05:50.441937 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6dc3668f-6712-4abf-978f-f08b64ffeac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:50.442540 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6dc3668f-6712-4abf-978f-f08b64ffeac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:50.449793 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dc3668f-6712-4abf-978f-f08b64ffeac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:50.450265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dc3668f-6712-4abf-978f-f08b64ffeac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:50.450695 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dc3668f-6712-4abf-978f-f08b64ffeac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:50.451374 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dc3668f-6712-4abf-978f-f08b64ffeac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:50.451818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dc3668f-6712-4abf-978f-f08b64ffeac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:50.452233 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6dc3668f-6712-4abf-978f-f08b64ffeac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:50.475134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-6dc3668f-6712-4abf-978f-f08b64ffeac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lazy-loading 'flavor' on Instance uuid df2b4ac0-60fb-4e49-9da3-039bcfff7698 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:05:50.665641 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6dc3668f-6712-4abf-978f-f08b64ffeac1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "POST /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/action" status: 202 len: 0 microversion: 2.20 time: 0.227289 Aug 30 02:05:50.666246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 615/1260] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 02:05:50 2022] POST /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:05:50.675627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:50.676301 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:50.687928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:50.689117 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:50.689682 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:50.690433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:50.690918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:50.691307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:50.853238 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:50.864151 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:50.865650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:50.866804 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-15b33604-3d88-4d37-bf5c-5daf95643b82 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.196210 Aug 30 02:05:50.867356 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 646/1261] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:05:50 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:05:51.891863 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:51.892626 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:51.898816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:51.899299 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:51.899736 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:51.900460 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:51.900914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:51.901340 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:51.906128 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:52.033204 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:52.042268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:52.043709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:52.045642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c50ade3d-2340-4cfa-9f43-212b583cb52c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.157981 Aug 30 02:05:52.045642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 616/1262] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:05:51 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:05:52.073231 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3ab80f37-a8de-4fb4-8061-71ce5074e289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:52.073727 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3ab80f37-a8de-4fb4-8061-71ce5074e289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:52.079555 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3ab80f37-a8de-4fb4-8061-71ce5074e289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:52.080031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3ab80f37-a8de-4fb4-8061-71ce5074e289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:52.080503 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3ab80f37-a8de-4fb4-8061-71ce5074e289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:52.081187 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3ab80f37-a8de-4fb4-8061-71ce5074e289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:52.081834 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3ab80f37-a8de-4fb4-8061-71ce5074e289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:52.082261 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3ab80f37-a8de-4fb4-8061-71ce5074e289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:52.105137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3ab80f37-a8de-4fb4-8061-71ce5074e289 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/ips" status: 200 len: 149 microversion: 2.1 time: 0.165059 Aug 30 02:05:52.105677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 647/1263] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 02:05:51 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/ips => generated 149 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:05:53.066807 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:53.067431 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:53.073789 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:53.074268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:53.074693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:53.075373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:53.075817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:53.076232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:53.204094 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:53.214602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:53.216348 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:53.218082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-21e8d08c-4289-4a38-a844-6d01a081e2c9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.155019 Aug 30 02:05:53.218846 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 617/1264] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:05:53 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:05:53.453186 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-eac9b1c3-3ee9-464e-a5bc-c1d7141b93dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83576d46-bd83-4329-9bac-c4d5bd5454f4"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:53.455595 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-eac9b1c3-3ee9-464e-a5bc-c1d7141b93dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:53.461981 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c3-3ee9-464e-a5bc-c1d7141b93dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:53.462451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c3-3ee9-464e-a5bc-c1d7141b93dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:53.462879 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c3-3ee9-464e-a5bc-c1d7141b93dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:53.463550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c3-3ee9-464e-a5bc-c1d7141b93dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:53.463994 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c3-3ee9-464e-a5bc-c1d7141b93dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:53.464456 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c3-3ee9-464e-a5bc-c1d7141b93dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:53.466848 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:53.745236 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-eac9b1c3-3ee9-464e-a5bc-c1d7141b93dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295687 Aug 30 02:05:53.745843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 648/1265] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 02:05:53 2022] POST /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:54.245461 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:54.246067 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:54.252380 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:54.252852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:54.253275 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:54.253953 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:54.254398 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:54.254811 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:54.385020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:54.393490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:54.394931 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:54.396094 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-48af64aa-fc82-4fc8-a67e-7c31fa8d2cce tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.155108 Aug 30 02:05:54.396682 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 618/1266] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:05:54 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:05:55.418411 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:55.419099 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:55.425760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:55.426239 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:55.426663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:55.427344 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:55.427787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:55.428205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:55.557515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:55.565396 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:55.566829 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:55.567965 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d61c9730-2a29-4570-a203-db0298465015 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.153826 Aug 30 02:05:55.568545 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 649/1267] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:05:55 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:05:56.590420 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:56.590956 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:56.597367 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:56.597849 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:56.598281 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:56.598960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:56.599407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:56.599825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:56.725104 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:56.733050 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:56.734465 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:56.735613 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0f3789c9-f651-4f6e-b675-06431fb12c75 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.149768 Aug 30 02:05:56.736162 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 619/1268] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:05:56 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:05:57.758892 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:57.759496 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:57.766119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:57.766592 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:57.767020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:57.767697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:57.768147 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:57.768612 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:57.893916 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:57.902416 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:57.903848 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:57.905022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e4ef7a3f-59e9-409f-b5df-2892432274e6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.150061 Aug 30 02:05:57.905585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 650/1269] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:05:57 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:05:58.926939 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:58.927543 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:58.934509 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:58.934982 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:58.935413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:58.936090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:58.936573 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:58.936994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:59.062453 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:59.070634 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:59.072734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:59.073882 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d1239e3f-3b41-4d6d-906a-d73bcf7bf041 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.150900 Aug 30 02:05:59.074627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 620/1270] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:05:58 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:00.097021 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:00.097451 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:00.100031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:00.105300 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:00.105783 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:00.106222 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:00.106918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:00.107372 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:00.107794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:00.237793 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:00.245749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:00.247172 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:00.248328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1ee18c69-e4f1-4bae-bbe1-c00e62c37253 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.155366 Aug 30 02:06:00.248877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 651/1271] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:00 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:01.266082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83576d46-bd83-4329-9bac-c4d5bd5454f4"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:01.268562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:01.270608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:01.271012 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:01.271220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:01.277411 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.277901 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.278270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.278400 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.278749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.279022 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.279180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.279476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.279869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.279970 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.280341 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.280768 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.364434 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Invalid volume: volume 83576d46-bd83-4329-9bac-c4d5bd5454f4 is already attached to instances: 134294ec-5f9d-4bb0-9072-1a5d77761ad0 Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: POST /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments HTTP/1.1 Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 74 Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:06:01.366171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {"volumeAttachment": {"volumeId": "83576d46-bd83-4329-9bac-c4d5bd5454f4"}} Aug 30 02:06:01.367766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Invalid volume: volume 83576d46-bd83-4329-9bac-c4d5bd5454f4 is already attached to instances: 134294ec-5f9d-4bb0-9072-1a5d77761ad0 Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'server_id': '134294ec-5f9d-4bb0-9072-1a5d77761ad0', 'body': {'volumeAttachment': {'volumeId': '83576d46-bd83-4329-9bac-c4d5bd5454f4'}}} Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 83576d46-bd83-4329-9bac-c4d5bd5454f4 is already attached to instances: 134294ec-5f9d-4bb0-9072-1a5d77761ad0 Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:06:01.371854 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 83576d46-bd83-4329-9bac-c4d5bd5454f4 is already attached to instances: 134294ec-5f9d-4bb0-9072-1a5d77761ad0 Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:01.373132 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:01.374497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:01.374497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:06:01.374497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:06:01.374497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 83576d46-bd83-4329-9bac-c4d5bd5454f4 is already attached to instances: 134294ec-5f9d-4bb0-9072-1a5d77761ad0 Aug 30 02:06:01.374497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:06:01.374497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 400 to user: Invalid volume: volume 83576d46-bd83-4329-9bac-c4d5bd5454f4 is already attached to instances: 134294ec-5f9d-4bb0-9072-1a5d77761ad0 {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:06:01.374497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-16b8852b-4658-4096-bae9-681606526082 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105551 Aug 30 02:06:01.374497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 621/1272] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 02:06:01 2022] POST /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:06:01.420487 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:01.424642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:01.427229 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:01.428926 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-92b6ca26-d43c-4bd7-9a21-62c7c0f0491a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.161770 Aug 30 02:06:01.429627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 652/1273] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:01 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:06:01.434586 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ac7a0f9b-e604-4e47-9dc8-7d5285a5674b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:01.435090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ac7a0f9b-e604-4e47-9dc8-7d5285a5674b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:01.441083 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac7a0f9b-e604-4e47-9dc8-7d5285a5674b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.441566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac7a0f9b-e604-4e47-9dc8-7d5285a5674b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.442002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac7a0f9b-e604-4e47-9dc8-7d5285a5674b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.442710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac7a0f9b-e604-4e47-9dc8-7d5285a5674b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.443143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac7a0f9b-e604-4e47-9dc8-7d5285a5674b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.443569 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac7a0f9b-e604-4e47-9dc8-7d5285a5674b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.522554 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-ac7a0f9b-e604-4e47-9dc8-7d5285a5674b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lazy-loading 'services' on Instance uuid 134294ec-5f9d-4bb0-9072-1a5d77761ad0 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:06:01.591857 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ac7a0f9b-e604-4e47-9dc8-7d5285a5674b tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments/83576d46-bd83-4329-9bac-c4d5bd5454f4" status: 202 len: 0 microversion: 2.1 time: 0.161250 Aug 30 02:06:01.592471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 622/1274] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:06:01 2022] DELETE /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments/83576d46-bd83-4329-9bac-c4d5bd5454f4 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:06:01.601533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0875bada-5cb8-4915-8f74-f56d7b8eff43 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:01.603787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0875bada-5cb8-4915-8f74-f56d7b8eff43 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:01.609761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0875bada-5cb8-4915-8f74-f56d7b8eff43 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.610278 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0875bada-5cb8-4915-8f74-f56d7b8eff43 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.610934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0875bada-5cb8-4915-8f74-f56d7b8eff43 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.611885 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0875bada-5cb8-4915-8f74-f56d7b8eff43 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.612442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0875bada-5cb8-4915-8f74-f56d7b8eff43 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.613158 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0875bada-5cb8-4915-8f74-f56d7b8eff43 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.646680 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0875bada-5cb8-4915-8f74-f56d7b8eff43 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049752 Aug 30 02:06:01.647227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 653/1275] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:06:01 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:02.452471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:02.453198 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:02.459268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:02.459744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:02.460208 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:02.460912 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:02.461364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:02.461781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:02.591591 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:02.599740 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:02.601187 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:02.603163 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-47a67682-3931-4036-9ed3-c83efddca5ee tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.155422 Aug 30 02:06:02.603816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 623/1276] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:02 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:02.658981 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-45474e73-55e2-42de-8dcc-8ababe7b26bb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:02.661328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-45474e73-55e2-42de-8dcc-8ababe7b26bb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:02.668260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45474e73-55e2-42de-8dcc-8ababe7b26bb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:02.668752 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45474e73-55e2-42de-8dcc-8ababe7b26bb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:02.669180 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45474e73-55e2-42de-8dcc-8ababe7b26bb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:02.669892 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45474e73-55e2-42de-8dcc-8ababe7b26bb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:02.670337 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45474e73-55e2-42de-8dcc-8ababe7b26bb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:02.670757 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-45474e73-55e2-42de-8dcc-8ababe7b26bb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:02.701030 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-45474e73-55e2-42de-8dcc-8ababe7b26bb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Aug 30 02:06:02.701600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 654/1277] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:06:02 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:03.626938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:03.627472 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:03.633859 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.634339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.634770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.635708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.636169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.636606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.713172 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c921609e-009c-4449-aaa1-ca6a916459e9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:03.715588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c921609e-009c-4449-aaa1-ca6a916459e9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:03.722164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c921609e-009c-4449-aaa1-ca6a916459e9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.722635 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c921609e-009c-4449-aaa1-ca6a916459e9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.723058 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c921609e-009c-4449-aaa1-ca6a916459e9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.723743 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c921609e-009c-4449-aaa1-ca6a916459e9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.724220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c921609e-009c-4449-aaa1-ca6a916459e9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.724664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c921609e-009c-4449-aaa1-ca6a916459e9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.753954 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c921609e-009c-4449-aaa1-ca6a916459e9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045222 Aug 30 02:06:03.754511 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 655/1278] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:06:03 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 02:06:03.767082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:03.775671 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:03.777127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:03.778291 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ccfb9b81-ece2-4d9c-afe5-840642f89826 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.155403 Aug 30 02:06:03.778843 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 624/1279] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:03 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:03.815930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-49c23545-5a34-4aee-9e6f-69475d1819eb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:03.816457 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-49c23545-5a34-4aee-9e6f-69475d1819eb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:03.822753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-49c23545-5a34-4aee-9e6f-69475d1819eb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.823225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-49c23545-5a34-4aee-9e6f-69475d1819eb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.823650 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-49c23545-5a34-4aee-9e6f-69475d1819eb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.824353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-49c23545-5a34-4aee-9e6f-69475d1819eb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.824796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-49c23545-5a34-4aee-9e6f-69475d1819eb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.825210 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-49c23545-5a34-4aee-9e6f-69475d1819eb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.849616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-49c23545-5a34-4aee-9e6f-69475d1819eb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Going to try to terminate instance {{(pid=120391) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:06:03.921183 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-49c23545-5a34-4aee-9e6f-69475d1819eb tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 204 len: 0 microversion: 2.1 time: 0.108653 Aug 30 02:06:03.921672 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 656/1280] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:06:03 2022] DELETE /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:06:03.929662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-57a4a6da-fc5c-47ed-a507-103fffb90401 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:03.930310 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-57a4a6da-fc5c-47ed-a507-103fffb90401 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:03.936093 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57a4a6da-fc5c-47ed-a507-103fffb90401 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.936600 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57a4a6da-fc5c-47ed-a507-103fffb90401 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.937028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57a4a6da-fc5c-47ed-a507-103fffb90401 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.937708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57a4a6da-fc5c-47ed-a507-103fffb90401 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.938145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57a4a6da-fc5c-47ed-a507-103fffb90401 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.938571 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-57a4a6da-fc5c-47ed-a507-103fffb90401 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:04.070029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-57a4a6da-fc5c-47ed-a507-103fffb90401 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:04.077605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-57a4a6da-fc5c-47ed-a507-103fffb90401 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1681 microversion: 2.1 time: 0.151755 Aug 30 02:06:04.078296 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 625/1281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:03 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:04.802087 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:04.802811 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:04.809108 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:04.809585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:04.810013 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:04.810691 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:04.811134 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:04.811552 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:04.938387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:04.947043 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:04.948636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:04.949789 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1d8345a2-c1d8-4425-b67c-167b6edc6e11 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.151930 Aug 30 02:06:04.950349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 657/1282] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:04 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:05.098807 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-bfeb0b07-7871-4109-b880-21ec98697445 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:05.099401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-bfeb0b07-7871-4109-b880-21ec98697445 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:05.105682 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfeb0b07-7871-4109-b880-21ec98697445 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.106169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfeb0b07-7871-4109-b880-21ec98697445 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.106601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfeb0b07-7871-4109-b880-21ec98697445 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:05.107283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfeb0b07-7871-4109-b880-21ec98697445 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.107735 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfeb0b07-7871-4109-b880-21ec98697445 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.108160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-bfeb0b07-7871-4109-b880-21ec98697445 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:05.233414 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-bfeb0b07-7871-4109-b880-21ec98697445 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:05.241044 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-bfeb0b07-7871-4109-b880-21ec98697445 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1681 microversion: 2.1 time: 0.146283 Aug 30 02:06:05.241592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 626/1283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:05 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:05.972553 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:05.973135 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:05.980214 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.980785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.981215 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:05.981924 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.982371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.982788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:06.111663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:06.119530 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:06.121000 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:06.122139 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cd0479c3-d784-4ae7-aded-99ca4b357573 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.153458 Aug 30 02:06:06.122713 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 658/1284] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:05 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:06.263696 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f977a9da-1a45-4ddf-a0ae-840a2386ba99 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:06.264389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f977a9da-1a45-4ddf-a0ae-840a2386ba99 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:06.270666 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f977a9da-1a45-4ddf-a0ae-840a2386ba99 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:06.271143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f977a9da-1a45-4ddf-a0ae-840a2386ba99 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:06.271577 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f977a9da-1a45-4ddf-a0ae-840a2386ba99 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:06.272292 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f977a9da-1a45-4ddf-a0ae-840a2386ba99 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:06.272738 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f977a9da-1a45-4ddf-a0ae-840a2386ba99 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:06.273153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f977a9da-1a45-4ddf-a0ae-840a2386ba99 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:06.408122 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f977a9da-1a45-4ddf-a0ae-840a2386ba99 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:06.415850 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f977a9da-1a45-4ddf-a0ae-840a2386ba99 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1681 microversion: 2.1 time: 0.157520 Aug 30 02:06:06.416439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 627/1285] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:06 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:07.049353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-b73bb0d2-16c8-46a8-8ba2-8b9a63d5d6fe req-2d48a021-3938-4aec-9692-567983eb5981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134294ec-5f9d-4bb0-9072-1a5d77761ad0", "name": "network-vif-deleted", "tag": "2ea2bd06-9ec6-4e33-a531-8388db110df2"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:07.060791 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b73bb0d2-16c8-46a8-8ba2-8b9a63d5d6fe req-2d48a021-3938-4aec-9692-567983eb5981 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:07.061279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b73bb0d2-16c8-46a8-8ba2-8b9a63d5d6fe req-2d48a021-3938-4aec-9692-567983eb5981 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:07.061736 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b73bb0d2-16c8-46a8-8ba2-8b9a63d5d6fe req-2d48a021-3938-4aec-9692-567983eb5981 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:07.074005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-b73bb0d2-16c8-46a8-8ba2-8b9a63d5d6fe req-2d48a021-3938-4aec-9692-567983eb5981 service nova] Creating event network-vif-deleted:2ea2bd06-9ec6-4e33-a531-8388db110df2 for instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 on hv-cinder-81966 Aug 30 02:06:07.078794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-b73bb0d2-16c8-46a8-8ba2-8b9a63d5d6fe req-2d48a021-3938-4aec-9692-567983eb5981 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033196 Aug 30 02:06:07.079386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 659/1286] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:07.146000 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:07.147259 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:07.155100 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:07.155632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:07.156071 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:07.156826 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:07.157281 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:07.157708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:07.305727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:07.313811 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:07.315238 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:07.316428 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c3d6daad-95df-4ce7-891e-bc13206e3089 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.174612 Aug 30 02:06:07.317178 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 628/1287] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:07 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:07.437329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:07.438032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:07.444615 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:07.445162 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:07.445603 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:07.446345 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:07.446803 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:07.447232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:07.480503 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:07.480997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:07.481440 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:07.481895 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lazy-loading 'fault' on Instance uuid 134294ec-5f9d-4bb0-9072-1a5d77761ad0 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:06:07.526429 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:07.534071 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1c7a4d91-23fe-4e33-a7df-493fe5fb64cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 200 len: 1331 microversion: 2.1 time: 0.101082 Aug 30 02:06:07.534655 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 660/1288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:07 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:08.339496 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:08.340107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:08.346476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:08.346951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:08.347385 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:08.348065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:08.348610 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:08.349036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:08.474801 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:08.482973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:08.484449 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:08.485604 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-d641bab8-7799-42a2-8d92-6ca95e8da34e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1746 microversion: 2.20 time: 0.150610 Aug 30 02:06:08.486152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 629/1289] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:08 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:08.555786 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:08.556322 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:08.563329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:08.563815 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:08.564455 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:08.565163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:08.565642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:08.566069 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:08.581475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 HTTP/1.1 Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:06:08.583094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:06:08.584677 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '134294ec-5f9d-4bb0-9072-1a5d77761ad0'} Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:06:08.585558 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:06:08.587408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:06:08.588696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:06:08.588696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-614754af-8c05-4414-aa44-14e3e3625daa tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 404 len: 111 microversion: 2.1 time: 0.032593 Aug 30 02:06:08.588696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 661/1290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:08 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:06:08.593971 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c3b66400-6009-4f8b-9338-aaaf89e929f5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '.version_select at 0x7f3b0847eb80>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:08.611860 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c3b66400-6009-4f8b-9338-aaaf89e929f5 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-603055405" status: 202 len: 0 microversion: 2.1 time: 0.021678 Aug 30 02:06:08.612442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 630/1291] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 30 02:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-603055405 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:06:09.218922 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a5030edd-9075-452f-9ee0-ba47764c84d0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: .version_select at 0x7f3b03f8bc10>, body: {"keypair": {"name": "tempest-keypair-1101461739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5ShelUhIQeOBJ4LPDuZ5n+oO/KYd9dlICO1CXFDe8W9eRa3neMFA28KO6va/0A0oWcqr5tqdYDm1ZXZeJvyP50gnELx/8qzWD9O/guubQiavgzJPt/GtCTeZYYA9Qfwg=="}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:09.234156 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-a5030edd-9075-452f-9ee0-ba47764c84d0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for project b9d96d936ce8417197008a59da394df7. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:06:09.237893 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.quota [None req-a5030edd-9075-452f-9ee0-ba47764c84d0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for user a06de37941264b979a3bd5aaf84ec73c and project b9d96d936ce8417197008a59da394df7. Resources: {'key_pairs'} {{(pid=120391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:06:09.260196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a5030edd-9075-452f-9ee0-ba47764c84d0 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044929 Aug 30 02:06:09.260811 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 662/1292] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 30 02:06:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:09.509403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:09.510373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:09.516597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:09.516969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:09.517401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:09.518098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:09.518546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:09.518973 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:09.654496 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:09.663109 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:09.665341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:09.667074 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-53308ae9-44ae-4548-aa9b-af27f4abbd51 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1746 microversion: 2.20 time: 0.162011 Aug 30 02:06:09.683699 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 631/1293] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:09 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:10.691547 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:10.692163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:10.697992 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:10.698464 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:10.698903 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:10.699595 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:10.700052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:10.700504 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:10.753022 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-916456945", "imageRef": "5d0dcd7c-fde6-45a5-b290-10373cb92b3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71f52012-15ba-448d-9108-20629e1d18ee"}], "security_groups": [{"name": "tempest-securitygroup--1729880789"}], "key_name": "tempest-keypair-1101461739", "user_data": "}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:10.833728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:10.836018 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:10.844546 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:10.845998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:10.847188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b46eb16a-f447-4ebe-aedc-c9d5429bab56 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1746 microversion: 2.20 time: 0.160329 Aug 30 02:06:10.847771 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 663/1294] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:10 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:10.858228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] validate_networks() for [('71f52012-15ba-448d-9108-20629e1d18ee', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:06:11.321011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:06:11.321446 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:06:11.321941 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:06:11.322340 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:06:11.322745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:06:11.331294 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:11.331764 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:11.332190 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:11.332933 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:11.333402 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:11.333826 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:11.349994 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for project b9d96d936ce8417197008a59da394df7. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:06:11.354630 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Getting quotas for user a06de37941264b979a3bd5aaf84ec73c and project b9d96d936ce8417197008a59da394df7. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:06:11.366123 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:06:11.369068 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d0dcd7c-fde6-45a5-b290-10373cb92b3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:06:11.414867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-45c32452-890b-4acb-809d-0f634df2f17a tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.665619 Aug 30 02:06:11.415608 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 632/1295] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 02:06:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 02:06:11.426733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-991b2af8-8b1f-4070-a973-d4ecf4760127 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:11.427430 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-991b2af8-8b1f-4070-a973-d4ecf4760127 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:11.483124 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-991b2af8-8b1f-4070-a973-d4ecf4760127 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:11.489911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-991b2af8-8b1f-4070-a973-d4ecf4760127 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1241 microversion: 2.1 time: 0.067240 Aug 30 02:06:11.490472 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 664/1296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:11 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:11.871320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:11.871901 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:11.880570 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:11.881011 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:11.881447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:11.882381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:11.883001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:11.884171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:12.034706 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:12.036936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:12.045021 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:12.046467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:12.047620 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-32a2e73e-52d2-4d47-a38a-f484479b55c3 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1746 microversion: 2.20 time: 0.181473 Aug 30 02:06:12.048160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 633/1297] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:11 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:12.071984 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-32e3191a-f5aa-4231-9638-54f46e802f9b req-b1adba98-c37a-4d56-89f1-c51a7d2f2249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2b4ac0-60fb-4e49-9da3-039bcfff7698", "name": "network-vif-plugged", "status": "completed", "tag": "b9d05127-de36-4e30-a898-feeb840846d0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:12.082899 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-32e3191a-f5aa-4231-9638-54f46e802f9b req-b1adba98-c37a-4d56-89f1-c51a7d2f2249 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:12.083376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-32e3191a-f5aa-4231-9638-54f46e802f9b req-b1adba98-c37a-4d56-89f1-c51a7d2f2249 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:12.083855 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-32e3191a-f5aa-4231-9638-54f46e802f9b req-b1adba98-c37a-4d56-89f1-c51a7d2f2249 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:12.096868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-32e3191a-f5aa-4231-9638-54f46e802f9b req-b1adba98-c37a-4d56-89f1-c51a7d2f2249 service nova] Creating event network-vif-plugged:b9d05127-de36-4e30-a898-feeb840846d0 for instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 on hv-cinder-81966 Aug 30 02:06:12.101724 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-32e3191a-f5aa-4231-9638-54f46e802f9b req-b1adba98-c37a-4d56-89f1-c51a7d2f2249 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Aug 30 02:06:12.102714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 665/1298] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:12.512117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3082a9c4-6456-4e4b-9064-b16313e5fc42 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:12.512757 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3082a9c4-6456-4e4b-9064-b16313e5fc42 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:12.518867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3082a9c4-6456-4e4b-9064-b16313e5fc42 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:12.519346 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3082a9c4-6456-4e4b-9064-b16313e5fc42 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:12.519786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3082a9c4-6456-4e4b-9064-b16313e5fc42 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:12.520501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3082a9c4-6456-4e4b-9064-b16313e5fc42 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:12.520953 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3082a9c4-6456-4e4b-9064-b16313e5fc42 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:12.521374 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3082a9c4-6456-4e4b-9064-b16313e5fc42 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:12.580979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3082a9c4-6456-4e4b-9064-b16313e5fc42 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:12.588463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3082a9c4-6456-4e4b-9064-b16313e5fc42 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1293 microversion: 2.1 time: 0.081801 Aug 30 02:06:12.589017 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 634/1299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:12 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:13.071957 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:13.072691 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:13.079270 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:13.079746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:13.080179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:13.080894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:13.081342 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:13.081762 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:13.285258 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:13.299387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:13.300878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:13.302040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a213792a-195f-4b61-b562-f903f7489191 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1746 microversion: 2.20 time: 0.234990 Aug 30 02:06:13.303067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 666/1300] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:13 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1746 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:13.608978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4136ccb6-391b-491e-876b-6bc420198c44 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:13.609585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4136ccb6-391b-491e-876b-6bc420198c44 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:13.615891 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4136ccb6-391b-491e-876b-6bc420198c44 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:13.616401 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4136ccb6-391b-491e-876b-6bc420198c44 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:13.616833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4136ccb6-391b-491e-876b-6bc420198c44 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:13.618138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4136ccb6-391b-491e-876b-6bc420198c44 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:13.618602 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4136ccb6-391b-491e-876b-6bc420198c44 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:13.619028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4136ccb6-391b-491e-876b-6bc420198c44 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:13.763214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4136ccb6-391b-491e-876b-6bc420198c44 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:13.771152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4136ccb6-391b-491e-876b-6bc420198c44 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1367 microversion: 2.1 time: 0.165913 Aug 30 02:06:13.771734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 635/1301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:13 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:14.325166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:14.325777 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:14.332135 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:14.333023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:14.333460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:14.334169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:14.334595 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:14.335015 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:14.454708 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-963cae83-74ea-4e1e-a596-4c2293cda8fd req-23174e7c-7868-455f-ae92-acd495beed1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b50d3ec-1225-4320-8c41-e394ffb2c672", "tag": "3732c5ab-0493-47ef-aa5f-28b96b148a74"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:14.464220 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-963cae83-74ea-4e1e-a596-4c2293cda8fd req-23174e7c-7868-455f-ae92-acd495beed1d service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:14.464731 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-963cae83-74ea-4e1e-a596-4c2293cda8fd req-23174e7c-7868-455f-ae92-acd495beed1d service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:14.465161 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-963cae83-74ea-4e1e-a596-4c2293cda8fd req-23174e7c-7868-455f-ae92-acd495beed1d service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:14.475810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-963cae83-74ea-4e1e-a596-4c2293cda8fd req-23174e7c-7868-455f-ae92-acd495beed1d service nova] Creating event network-changed:3732c5ab-0493-47ef-aa5f-28b96b148a74 for instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 on hv-cinder-81966 Aug 30 02:06:14.481194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-963cae83-74ea-4e1e-a596-4c2293cda8fd req-23174e7c-7868-455f-ae92-acd495beed1d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030147 Aug 30 02:06:14.481946 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 636/1302] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:06:14.538225 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:14.547241 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:14.548704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:14.550088 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-73dcb356-eee0-4958-a3e3-3b2e2a5e4ac5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1746 microversion: 2.20 time: 0.229142 Aug 30 02:06:14.550639 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 667/1303] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:14 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1746 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:14.793245 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-08646a7b-71e3-4a2f-8f57-053b17a27ea2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:14.794728 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-08646a7b-71e3-4a2f-8f57-053b17a27ea2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:14.801807 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-08646a7b-71e3-4a2f-8f57-053b17a27ea2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:14.802623 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-08646a7b-71e3-4a2f-8f57-053b17a27ea2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:14.803121 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-08646a7b-71e3-4a2f-8f57-053b17a27ea2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:14.804080 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-08646a7b-71e3-4a2f-8f57-053b17a27ea2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:14.804957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-08646a7b-71e3-4a2f-8f57-053b17a27ea2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:14.805385 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-08646a7b-71e3-4a2f-8f57-053b17a27ea2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:14.945139 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-08646a7b-71e3-4a2f-8f57-053b17a27ea2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:14.956905 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-08646a7b-71e3-4a2f-8f57-053b17a27ea2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1367 microversion: 2.1 time: 0.168333 Aug 30 02:06:14.957483 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 637/1304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:14 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:15.580974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:15.581501 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:15.592500 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:15.593699 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:15.594551 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:15.596125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:15.596607 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:15.597030 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:15.755399 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:15.781651 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:15.783664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:15.785315 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8ae63ac6-16d3-472b-a1bb-4fdaa08d0fa8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1741 microversion: 2.20 time: 0.210229 Aug 30 02:06:15.786435 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 668/1305] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:15 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:15.978504 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6018d7c4-f618-4a90-b4da-396923fb4b81 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:15.979103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6018d7c4-f618-4a90-b4da-396923fb4b81 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:15.986374 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6018d7c4-f618-4a90-b4da-396923fb4b81 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:15.986855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6018d7c4-f618-4a90-b4da-396923fb4b81 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:15.987525 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6018d7c4-f618-4a90-b4da-396923fb4b81 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:15.988273 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6018d7c4-f618-4a90-b4da-396923fb4b81 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:15.988767 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6018d7c4-f618-4a90-b4da-396923fb4b81 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:15.989191 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6018d7c4-f618-4a90-b4da-396923fb4b81 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:16.138615 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6018d7c4-f618-4a90-b4da-396923fb4b81 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:16.146354 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6018d7c4-f618-4a90-b4da-396923fb4b81 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1367 microversion: 2.1 time: 0.172559 Aug 30 02:06:16.146908 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 638/1306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:15 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:16.811683 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:16.812661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:16.818442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:16.819220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:16.819818 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:16.821249 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:16.821693 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:16.822280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:16.979126 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:16.987857 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:16.989560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:16.990695 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-65151c13-6110-4c85-9097-f41000798dc5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1741 microversion: 2.20 time: 0.185266 Aug 30 02:06:16.991726 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 669/1307] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:16 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:06:17.168284 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2d26ae8c-a0fe-4eff-8747-9c30718c53fe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:17.169645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2d26ae8c-a0fe-4eff-8747-9c30718c53fe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:17.176452 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d26ae8c-a0fe-4eff-8747-9c30718c53fe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:17.177287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d26ae8c-a0fe-4eff-8747-9c30718c53fe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:17.178025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d26ae8c-a0fe-4eff-8747-9c30718c53fe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:17.178931 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d26ae8c-a0fe-4eff-8747-9c30718c53fe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:17.179529 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d26ae8c-a0fe-4eff-8747-9c30718c53fe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:17.180191 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2d26ae8c-a0fe-4eff-8747-9c30718c53fe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:17.327701 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2d26ae8c-a0fe-4eff-8747-9c30718c53fe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:17.336201 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2d26ae8c-a0fe-4eff-8747-9c30718c53fe tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1367 microversion: 2.1 time: 0.173009 Aug 30 02:06:17.336802 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 639/1308] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:17 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:18.021235 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:18.022674 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:18.032347 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:18.038477 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:18.039111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:18.040530 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:18.040983 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:18.041408 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:18.208815 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:18.219804 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:18.221303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:18.222848 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-894fa69f-0376-4ed4-8b4b-a21709f5a6b5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1741 microversion: 2.20 time: 0.205619 Aug 30 02:06:18.223760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 670/1309] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:18 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:18.356916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-672b1cf9-fb20-40bc-aa9b-f2aadece29dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:18.357687 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-672b1cf9-fb20-40bc-aa9b-f2aadece29dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:18.368527 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-672b1cf9-fb20-40bc-aa9b-f2aadece29dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:18.369098 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-672b1cf9-fb20-40bc-aa9b-f2aadece29dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:18.369722 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-672b1cf9-fb20-40bc-aa9b-f2aadece29dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:18.370473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-672b1cf9-fb20-40bc-aa9b-f2aadece29dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:18.370928 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-672b1cf9-fb20-40bc-aa9b-f2aadece29dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:18.371351 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-672b1cf9-fb20-40bc-aa9b-f2aadece29dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:18.513183 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-672b1cf9-fb20-40bc-aa9b-f2aadece29dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:18.521781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-672b1cf9-fb20-40bc-aa9b-f2aadece29dc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1367 microversion: 2.1 time: 0.168855 Aug 30 02:06:18.522566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 640/1310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:18 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:19.248851 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:19.249480 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:19.255946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:19.256485 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:19.256937 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:19.257630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:19.258357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:19.259020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:19.404375 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:19.413567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:19.415761 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:19.417918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-65c3a960-3f3a-4ca3-b232-cf294c4e6117 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1741 microversion: 2.20 time: 0.172355 Aug 30 02:06:19.419644 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 671/1311] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:19 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:19.548834 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1a7bcb9f-5368-4689-82e3-cf6edc593862 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:19.549374 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1a7bcb9f-5368-4689-82e3-cf6edc593862 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:19.555665 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a7bcb9f-5368-4689-82e3-cf6edc593862 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:19.556169 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a7bcb9f-5368-4689-82e3-cf6edc593862 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:19.556680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a7bcb9f-5368-4689-82e3-cf6edc593862 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:19.557414 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a7bcb9f-5368-4689-82e3-cf6edc593862 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:19.557833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a7bcb9f-5368-4689-82e3-cf6edc593862 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:19.558463 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1a7bcb9f-5368-4689-82e3-cf6edc593862 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:19.711817 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-1a7bcb9f-5368-4689-82e3-cf6edc593862 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:19.720045 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1a7bcb9f-5368-4689-82e3-cf6edc593862 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1367 microversion: 2.1 time: 0.175218 Aug 30 02:06:19.721435 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 641/1312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:19 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:20.096302 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-b10f49a4-59d0-4bb2-8ca5-2222d9ed44b7 req-28798d0f-0ef1-45b1-be88-7b53d7f2a04b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b50d3ec-1225-4320-8c41-e394ffb2c672", "name": "network-vif-plugged", "status": "completed", "tag": "3732c5ab-0493-47ef-aa5f-28b96b148a74"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:20.105592 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b10f49a4-59d0-4bb2-8ca5-2222d9ed44b7 req-28798d0f-0ef1-45b1-be88-7b53d7f2a04b service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:20.106630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b10f49a4-59d0-4bb2-8ca5-2222d9ed44b7 req-28798d0f-0ef1-45b1-be88-7b53d7f2a04b service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:20.107162 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b10f49a4-59d0-4bb2-8ca5-2222d9ed44b7 req-28798d0f-0ef1-45b1-be88-7b53d7f2a04b service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:20.120122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-b10f49a4-59d0-4bb2-8ca5-2222d9ed44b7 req-28798d0f-0ef1-45b1-be88-7b53d7f2a04b service nova] Creating event network-vif-plugged:3732c5ab-0493-47ef-aa5f-28b96b148a74 for instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 on hv-cinder-81966 Aug 30 02:06:20.125163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-b10f49a4-59d0-4bb2-8ca5-2222d9ed44b7 req-28798d0f-0ef1-45b1-be88-7b53d7f2a04b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 Aug 30 02:06:20.126082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 672/1313] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:20.441692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:20.442397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:20.456565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:20.457065 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:20.457526 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:20.458238 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:20.458693 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:20.459111 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:20.622744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:20.630975 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:20.632434 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:20.633619 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-efb455f7-4899-461c-a1ae-b735728077ae tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1741 microversion: 2.20 time: 0.196011 Aug 30 02:06:20.644277 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 642/1314] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:20 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:20.742515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8f4984ff-98f5-4717-990a-2bb09ce43f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:20.744070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8f4984ff-98f5-4717-990a-2bb09ce43f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:20.750501 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f4984ff-98f5-4717-990a-2bb09ce43f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:20.750982 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f4984ff-98f5-4717-990a-2bb09ce43f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:20.751413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f4984ff-98f5-4717-990a-2bb09ce43f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:20.752102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f4984ff-98f5-4717-990a-2bb09ce43f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:20.752581 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f4984ff-98f5-4717-990a-2bb09ce43f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:20.753188 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8f4984ff-98f5-4717-990a-2bb09ce43f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:20.896895 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8f4984ff-98f5-4717-990a-2bb09ce43f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:20.906392 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8f4984ff-98f5-4717-990a-2bb09ce43f48 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1367 microversion: 2.1 time: 0.168549 Aug 30 02:06:20.907329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 673/1315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:20 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:21.656872 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:21.658067 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:21.660396 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:21.661195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:21.670564 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:21.671134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:21.671642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:21.672480 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:21.672940 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:21.673367 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:21.827825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:21.840036 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:21.843416 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:21.845054 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f7c2c14d-a1e0-4edc-8ba9-30b73fb5b9df tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1741 microversion: 2.20 time: 0.191920 Aug 30 02:06:21.845561 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 643/1316] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:21 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:21.930020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-71a03364-3fe7-4f70-a5d6-e8eaaf96388c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:21.930643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-71a03364-3fe7-4f70-a5d6-e8eaaf96388c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:21.932699 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=6 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:21.939467 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71a03364-3fe7-4f70-a5d6-e8eaaf96388c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:21.940065 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71a03364-3fe7-4f70-a5d6-e8eaaf96388c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:21.940588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71a03364-3fe7-4f70-a5d6-e8eaaf96388c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:21.941506 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71a03364-3fe7-4f70-a5d6-e8eaaf96388c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:21.942162 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71a03364-3fe7-4f70-a5d6-e8eaaf96388c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:21.942679 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-71a03364-3fe7-4f70-a5d6-e8eaaf96388c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:22.085421 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-71a03364-3fe7-4f70-a5d6-e8eaaf96388c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:22.092965 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-71a03364-3fe7-4f70-a5d6-e8eaaf96388c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1367 microversion: 2.1 time: 0.167857 Aug 30 02:06:22.093515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 674/1317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:21 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:22.872025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:22.874958 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:22.883960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:22.884567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:22.885365 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:22.887963 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:22.889447 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:22.889952 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:23.048874 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:23.058478 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:23.059963 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:23.061607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3c27985b-df5c-4157-9fb6-98761cda9855 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1741 microversion: 2.20 time: 0.197567 Aug 30 02:06:23.065704 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 644/1318] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:22 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:23.114032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-433e7ef8-12f2-47e6-bf4c-7b00a7d95f24 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:23.115223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-433e7ef8-12f2-47e6-bf4c-7b00a7d95f24 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:23.122314 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-433e7ef8-12f2-47e6-bf4c-7b00a7d95f24 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:23.122723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-433e7ef8-12f2-47e6-bf4c-7b00a7d95f24 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:23.123150 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-433e7ef8-12f2-47e6-bf4c-7b00a7d95f24 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:23.123843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-433e7ef8-12f2-47e6-bf4c-7b00a7d95f24 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:23.124313 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-433e7ef8-12f2-47e6-bf4c-7b00a7d95f24 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:23.124734 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-433e7ef8-12f2-47e6-bf4c-7b00a7d95f24 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:23.329120 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-433e7ef8-12f2-47e6-bf4c-7b00a7d95f24 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:23.338725 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-433e7ef8-12f2-47e6-bf4c-7b00a7d95f24 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1556 microversion: 2.1 time: 0.228400 Aug 30 02:06:23.339312 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 675/1319] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:23 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1556 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:23.360192 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-992f5618-4c26-4b46-a511-d98262941f65 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:23.360725 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-992f5618-4c26-4b46-a511-d98262941f65 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:23.367186 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-992f5618-4c26-4b46-a511-d98262941f65 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:23.367674 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-992f5618-4c26-4b46-a511-d98262941f65 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:23.368105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-992f5618-4c26-4b46-a511-d98262941f65 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:23.368874 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-992f5618-4c26-4b46-a511-d98262941f65 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:23.369325 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-992f5618-4c26-4b46-a511-d98262941f65 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:23.369744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-992f5618-4c26-4b46-a511-d98262941f65 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:23.453999 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-992f5618-4c26-4b46-a511-d98262941f65 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097723 Aug 30 02:06:23.454633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 645/1320] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 30 02:06:23 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:24.090487 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:24.091498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:24.098202 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.098886 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.099326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.100357 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.101014 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.101459 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.237721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:24.246029 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:24.247597 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:24.248772 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4074251c-dd55-44bd-97ff-bf1e73f7b5b9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1741 microversion: 2.20 time: 0.162163 Aug 30 02:06:24.249317 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 676/1321] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:24 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:24.422369 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-7d0e59c2-80cb-45d2-91f4-2b62dde49763 req-2fdd7c1a-68b6-4e48-91db-6d4d99bd026a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b50d3ec-1225-4320-8c41-e394ffb2c672", "tag": "3732c5ab-0493-47ef-aa5f-28b96b148a74"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:24.432131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-7d0e59c2-80cb-45d2-91f4-2b62dde49763 req-2fdd7c1a-68b6-4e48-91db-6d4d99bd026a service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.432627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-7d0e59c2-80cb-45d2-91f4-2b62dde49763 req-2fdd7c1a-68b6-4e48-91db-6d4d99bd026a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.433048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-7d0e59c2-80cb-45d2-91f4-2b62dde49763 req-2fdd7c1a-68b6-4e48-91db-6d4d99bd026a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.443868 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-7d0e59c2-80cb-45d2-91f4-2b62dde49763 req-2fdd7c1a-68b6-4e48-91db-6d4d99bd026a service nova] Creating event network-changed:3732c5ab-0493-47ef-aa5f-28b96b148a74 for instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 on hv-cinder-81966 Aug 30 02:06:24.448835 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-7d0e59c2-80cb-45d2-91f4-2b62dde49763 req-2fdd7c1a-68b6-4e48-91db-6d4d99bd026a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030506 Aug 30 02:06:24.449420 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 646/1322] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:25.273265 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:25.274528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:25.281271 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:25.282058 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:25.282773 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:25.283567 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:25.284398 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:25.285040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:25.526931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:25.534884 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:25.536339 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:25.537488 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-700bb5c4-fe0c-463b-a2b0-18837b6a4c1a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1723 microversion: 2.20 time: 0.268143 Aug 30 02:06:25.538047 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 677/1323] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:25 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:26.561842 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:26.562462 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:26.569262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:26.569750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:26.570186 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:26.571377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:26.571827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:26.572268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:26.698146 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:26.706073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:26.707505 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:26.708714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-439b7f71-bd50-4312-b278-9ab7de9faccd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1723 microversion: 2.20 time: 0.151236 Aug 30 02:06:26.709267 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 647/1324] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:26 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:27.730893 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:27.731505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:27.737893 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.738381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.738810 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:27.739497 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.739944 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.740515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:27.881857 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:27.890331 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:27.891784 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:27.892945 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4246d494-6b19-4e02-ac5e-164cec2405be tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1726 microversion: 2.20 time: 0.166005 Aug 30 02:06:27.893476 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 678/1325] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:27 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:27.916424 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b7205391-35f3-42ad-8ec3-76195b5214f8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec7d5148-3005-4025-9a48-f631533c8b06"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:27.918714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-b7205391-35f3-42ad-8ec3-76195b5214f8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:27.925238 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7205391-35f3-42ad-8ec3-76195b5214f8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.925714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7205391-35f3-42ad-8ec3-76195b5214f8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.926142 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7205391-35f3-42ad-8ec3-76195b5214f8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:27.926827 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7205391-35f3-42ad-8ec3-76195b5214f8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.927268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7205391-35f3-42ad-8ec3-76195b5214f8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.927680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-b7205391-35f3-42ad-8ec3-76195b5214f8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.091939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-7e317801-107e-4fb2-9c24-a7acc51bfc8c req-eddbac77-1d94-48a9-b24b-e0a5fe0cc4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2b4ac0-60fb-4e49-9da3-039bcfff7698", "name": "network-vif-unplugged", "status": "completed", "tag": "b9d05127-de36-4e30-a898-feeb840846d0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:28.104518 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-7e317801-107e-4fb2-9c24-a7acc51bfc8c req-eddbac77-1d94-48a9-b24b-e0a5fe0cc4a6 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.105121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-7e317801-107e-4fb2-9c24-a7acc51bfc8c req-eddbac77-1d94-48a9-b24b-e0a5fe0cc4a6 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.105860 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-7e317801-107e-4fb2-9c24-a7acc51bfc8c req-eddbac77-1d94-48a9-b24b-e0a5fe0cc4a6 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.119927 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-7e317801-107e-4fb2-9c24-a7acc51bfc8c req-eddbac77-1d94-48a9-b24b-e0a5fe0cc4a6 service nova] Creating event network-vif-unplugged:b9d05127-de36-4e30-a898-feeb840846d0 for instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 on hv-cinder-81966 Aug 30 02:06:28.125995 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-7e317801-107e-4fb2-9c24-a7acc51bfc8c req-eddbac77-1d94-48a9-b24b-e0a5fe0cc4a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037921 Aug 30 02:06:28.126784 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 679/1326] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:06:28.209269 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b7205391-35f3-42ad-8ec3-76195b5214f8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "POST /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297364 Aug 30 02:06:28.209865 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 648/1327] 10.222.0.50 () {62 vars in 1364 bytes} [Tue Aug 30 02:06:27 2022] POST /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:06:28.334060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-59cc142c-498c-4dca-b921-81dd7c8a3803 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:28.334735 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-59cc142c-498c-4dca-b921-81dd7c8a3803 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:28.341631 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-59cc142c-498c-4dca-b921-81dd7c8a3803 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.342105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-59cc142c-498c-4dca-b921-81dd7c8a3803 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.342533 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-59cc142c-498c-4dca-b921-81dd7c8a3803 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.343219 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-59cc142c-498c-4dca-b921-81dd7c8a3803 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.343662 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-59cc142c-498c-4dca-b921-81dd7c8a3803 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.344079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-59cc142c-498c-4dca-b921-81dd7c8a3803 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.585217 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:28.590524 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-59cc142c-498c-4dca-b921-81dd7c8a3803 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "DELETE /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/os-volume_attachments/ec7d5148-3005-4025-9a48-f631533c8b06" status: 202 len: 0 microversion: 2.20 time: 0.260942 Aug 30 02:06:28.591094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 680/1328] 10.222.0.50 () {60 vars in 1457 bytes} [Tue Aug 30 02:06:28 2022] DELETE /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/os-volume_attachments/ec7d5148-3005-4025-9a48-f631533c8b06 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 02:06:28.649610 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-41113bda-4073-4c75-8c37-11e9cfb0cdbf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:28.650143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-41113bda-4073-4c75-8c37-11e9cfb0cdbf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:28.656032 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41113bda-4073-4c75-8c37-11e9cfb0cdbf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.656547 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41113bda-4073-4c75-8c37-11e9cfb0cdbf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.656978 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41113bda-4073-4c75-8c37-11e9cfb0cdbf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.657658 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41113bda-4073-4c75-8c37-11e9cfb0cdbf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.658106 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41113bda-4073-4c75-8c37-11e9cfb0cdbf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.658529 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-41113bda-4073-4c75-8c37-11e9cfb0cdbf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.672180 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:28.702517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-41113bda-4073-4c75-8c37-11e9cfb0cdbf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120392) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 02:06:28.769331 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-41113bda-4073-4c75-8c37-11e9cfb0cdbf tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "POST /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/action" status: 202 len: 0 microversion: 2.20 time: 0.124235 Aug 30 02:06:28.769969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 649/1329] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 30 02:06:28 2022] POST /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:06:28.779163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:28.780311 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:28.787208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.787697 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.788130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.788932 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.789449 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.789955 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.920137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:28.928194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:28.930163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:28.931293 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3b715a14-a830-4fee-b593-fb18f05889af tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1674 microversion: 2.20 time: 0.156356 Aug 30 02:06:28.931828 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 681/1330] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:28 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:29.955449 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:29.956051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:29.962565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:29.963037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:29.963462 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:29.964135 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:29.964611 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:29.965026 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:30.092339 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:30.100175 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:30.101726 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:30.102868 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-af6e4e6c-7a9b-4f3f-91fc-135f7e95965e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.151836 Aug 30 02:06:30.103418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 650/1331] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:29 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:31.134704 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:31.136386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:31.153280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:31.157706 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:31.159713 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:31.161251 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:31.163020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:31.163868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:31.165642 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:31.340385 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:31.349091 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:31.350618 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:31.352437 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4c7d93a3-64b5-4c3a-b303-c92b9eb2afed tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.227437 Aug 30 02:06:31.372864 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 682/1332] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:31 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:32.375090 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:32.375692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:32.378471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:32.383713 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:32.384184 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:32.384629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:32.385565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:32.386010 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:32.386425 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:32.530372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:32.538383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:32.540345 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:32.541495 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-245a2bd7-2e3e-43c4-9741-195cad46d713 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.170352 Aug 30 02:06:32.542037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 651/1333] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:32 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:33.565218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:33.565764 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:33.573023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:33.573552 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:33.573930 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:33.574629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:33.575076 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:33.575499 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:33.718284 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:33.726909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:33.728401 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:33.729589 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4b65a8c2-6256-4280-8d00-83b9cc343170 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.168342 Aug 30 02:06:33.730157 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 683/1334] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:33 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:34.753067 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:34.753883 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:34.761302 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:34.761876 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:34.762373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:34.763134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:34.763653 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:34.764144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:35.185929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:35.197734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:35.199323 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:35.201812 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c529d80d-6129-4252-a969-fac30e855866 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.451562 Aug 30 02:06:35.202459 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 652/1335] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:34 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:36.224700 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:36.225404 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:36.231630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:36.232102 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:36.232587 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:36.233269 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:36.233712 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:36.234130 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:36.359386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:36.367295 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:36.368777 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:36.369919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-4463da78-0ae5-4bda-be3f-cdfab0034590 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.149081 Aug 30 02:06:36.370462 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 684/1336] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:36 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:37.393021 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:37.393642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:37.400654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:37.401140 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:37.401578 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:37.402265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:37.402716 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:37.403141 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:37.561554 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:37.569461 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:37.571472 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:37.572654 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f4c493b0-1338-4187-ab74-bef493d0ad19 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.183535 Aug 30 02:06:37.573205 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 653/1337] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:37 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:38.595799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:38.596473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:38.603321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:38.603806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:38.604260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:38.604964 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:38.605421 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:38.605851 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:38.736885 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:38.744946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:38.746377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:38.747515 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-662fc024-4c2a-4528-8340-3037f94927dd tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.155643 Aug 30 02:06:38.748069 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 685/1338] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:38 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:39.770548 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:39.771241 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:39.777796 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:39.778283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:39.778720 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:39.779407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:39.779860 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:39.780310 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:39.916848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:39.925174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:39.926601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:39.927759 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c61ead95-8221-491f-9493-92c599586f04 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.161140 Aug 30 02:06:39.943800 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 654/1339] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:39 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:40.951242 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:40.951897 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:40.958260 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:40.958743 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:40.959182 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:40.959876 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:40.960450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:40.961382 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:41.090058 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:41.098010 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:41.099432 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:41.100610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-511a630a-ad90-411b-b3ec-ecb3ca8e2020 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.153545 Aug 30 02:06:41.101165 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 686/1340] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:40 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:42.123742 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:42.124418 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:42.130407 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:42.130893 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:42.131328 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:42.132016 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:42.133105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:42.133534 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:42.266833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:42.275754 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:42.277584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:42.279013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9e4a77e1-f994-433a-8deb-2aaf32e5f47d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.159373 Aug 30 02:06:42.279805 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 655/1341] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:42 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:43.302145 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:43.302747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:43.309328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:43.309803 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:43.310229 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:43.310904 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:43.311347 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:43.311760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:43.447236 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:43.455820 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:43.457277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:43.458478 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cbdc5fd7-f769-4d10-9652-7a08b143c753 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.160198 Aug 30 02:06:43.459218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 687/1342] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:43 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:44.481918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:44.482526 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:44.489112 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:44.489593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:44.490025 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:44.490702 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:44.491153 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:44.491572 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:44.619383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:44.627964 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:44.629436 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:44.630593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3a54ebed-8fbd-40f2-b664-babb6e858c9e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.152750 Aug 30 02:06:44.631138 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 656/1343] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:44 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:45.654380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:45.654921 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:45.661326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:45.661800 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:45.662228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:45.662904 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:45.663349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:45.663763 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:45.794129 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:45.801981 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:45.803402 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:45.804561 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ebf3aa11-595b-487d-8334-e4dec228fdb5 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.154100 Aug 30 02:06:45.805110 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 688/1344] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:45 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:46.827710 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:46.828395 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:46.834752 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:46.835225 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:46.835651 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:46.836350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:46.836796 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:46.837214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:46.962337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:46.970786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:46.972200 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:46.973363 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-10eaa99d-af4e-4e8b-be90-bde1a77f71b2 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.149656 Aug 30 02:06:46.973907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 657/1345] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:46 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:47.997326 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:47.997939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:48.004353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:48.004829 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:48.005253 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:48.005931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:48.006377 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:48.006795 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:48.133475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:48.141891 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:48.143321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:48.144488 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b98a6443-01e0-4406-80f2-68decf30938d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.151629 Aug 30 02:06:48.145040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 689/1346] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:47 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:49.167729 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:49.168357 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:49.174775 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:49.175243 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:49.175667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:49.176366 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:49.176813 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:49.177229 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:49.311524 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:49.319409 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:49.320910 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:49.322052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fc6c4e06-41f3-4477-b7aa-456483d2d387 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.158384 Aug 30 02:06:49.322702 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 658/1347] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:49 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:06:50.344651 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:50.345194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:50.351522 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:50.352002 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:50.352464 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:50.353139 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:50.353584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:50.354003 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:50.507005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:50.515251 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:50.516740 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:50.517933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5ddcdef1-18ed-4e41-b6bf-60b6629d3f83 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.177307 Aug 30 02:06:50.518509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 690/1348] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:50 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:51.541496 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:51.542103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:51.548677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:51.549095 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:51.549519 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:51.550194 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:51.550643 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:51.551060 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:51.685454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:51.693612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:51.695035 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:51.696177 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-39e224b0-8190-4186-8116-6117eda5754d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.159287 Aug 30 02:06:51.696751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 659/1349] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:51 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:52.321282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-f1a75391-576c-4c7c-8e86-5ca64310fbad req-4fe19072-5bdd-4bbf-afe3-f7cf363cc1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2b4ac0-60fb-4e49-9da3-039bcfff7698", "name": "network-vif-plugged", "status": "completed", "tag": "b9d05127-de36-4e30-a898-feeb840846d0"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:52.331529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-f1a75391-576c-4c7c-8e86-5ca64310fbad req-4fe19072-5bdd-4bbf-afe3-f7cf363cc1d5 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:52.331997 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-f1a75391-576c-4c7c-8e86-5ca64310fbad req-4fe19072-5bdd-4bbf-afe3-f7cf363cc1d5 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:52.332455 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-f1a75391-576c-4c7c-8e86-5ca64310fbad req-4fe19072-5bdd-4bbf-afe3-f7cf363cc1d5 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:52.343306 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-f1a75391-576c-4c7c-8e86-5ca64310fbad req-4fe19072-5bdd-4bbf-afe3-f7cf363cc1d5 service nova] Creating event network-vif-plugged:b9d05127-de36-4e30-a898-feeb840846d0 for instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 on hv-cinder-81966 Aug 30 02:06:52.348137 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-f1a75391-576c-4c7c-8e86-5ca64310fbad req-4fe19072-5bdd-4bbf-afe3-f7cf363cc1d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092946 Aug 30 02:06:52.348796 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 691/1350] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:52.719383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:52.719987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:52.726740 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:52.727215 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:52.727642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:52.728372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:52.728819 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:52.729243 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:52.860820 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:52.868804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:52.870233 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:52.871378 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-4a4328b4-8bb7-4270-8180-4536c6d6b15f tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.155959 Aug 30 02:06:52.871919 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 660/1351] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:52 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:53.895967 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:53.896689 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:53.902809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:53.903289 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:53.903723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:53.904441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:53.904892 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:53.905317 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:54.031646 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:54.039745 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:54.041228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:54.042364 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b91dce7d-7c12-4595-a5b5-9fac536e5f12 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.151295 Aug 30 02:06:54.042939 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 692/1352] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:53 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:55.065989 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:55.066592 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:55.073341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:55.073851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:55.074232 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:55.074923 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:55.075370 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:55.075787 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:55.215160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:55.223918 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:55.225383 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:55.226554 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5023d821-1738-435e-970f-796dc0b56c53 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1732 microversion: 2.20 time: 0.164493 Aug 30 02:06:55.227076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 661/1353] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:55 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:06:56.250946 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:56.251549 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:56.257999 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:56.258481 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:56.258915 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:56.259596 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:56.260074 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:56.260777 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:56.388159 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:56.396103 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:56.397592 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:56.398741 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cdf5e2d1-0ef6-46ca-a1c2-f766188ad5b1 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1719 microversion: 2.20 time: 0.152331 Aug 30 02:06:56.399290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 693/1354] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:06:56 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:07:02.975052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-eba6a4e0-f041-4176-ae42-ff5af3dec4b1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1330017264"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:02.975621 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-eba6a4e0-f041-4176-ae42-ff5af3dec4b1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:02.978085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=22 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:02.983366 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eba6a4e0-f041-4176-ae42-ff5af3dec4b1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:02.983855 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eba6a4e0-f041-4176-ae42-ff5af3dec4b1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:02.984318 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eba6a4e0-f041-4176-ae42-ff5af3dec4b1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:02.985020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eba6a4e0-f041-4176-ae42-ff5af3dec4b1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:02.985476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eba6a4e0-f041-4176-ae42-ff5af3dec4b1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:02.985904 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-eba6a4e0-f041-4176-ae42-ff5af3dec4b1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:02.989685 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:03.114944 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.network.security_group_api [None req-eba6a4e0-f041-4176-ae42-ff5af3dec4b1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Removing security group 0ffb3dc9-f939-41e9-bbe4-57c9aea3b9b6 from port 368b4b69-ee2c-423b-823b-2d0eae43ecae Aug 30 02:07:03.422171 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-eba6a4e0-f041-4176-ae42-ff5af3dec4b1 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "POST /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/action" status: 202 len: 0 microversion: 2.1 time: 0.450992 Aug 30 02:07:03.422780 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 662/1355] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 30 02:07:02 2022] POST /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:03.449744 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-1ccc0938-95b2-47da-9fe5-fbae9ed3eb26 req-cbbd4b0c-6e4a-4805-987e-ef29d835ecf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ed5413-5513-4b3f-8588-34ba725fff26", "tag": "368b4b69-ee2c-423b-823b-2d0eae43ecae"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:03.456363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=24 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:03.463853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-1ccc0938-95b2-47da-9fe5-fbae9ed3eb26 req-cbbd4b0c-6e4a-4805-987e-ef29d835ecf0 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:03.464531 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-1ccc0938-95b2-47da-9fe5-fbae9ed3eb26 req-cbbd4b0c-6e4a-4805-987e-ef29d835ecf0 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:03.464969 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-1ccc0938-95b2-47da-9fe5-fbae9ed3eb26 req-cbbd4b0c-6e4a-4805-987e-ef29d835ecf0 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:03.479746 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=75 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:03.482076 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-1ccc0938-95b2-47da-9fe5-fbae9ed3eb26 req-cbbd4b0c-6e4a-4805-987e-ef29d835ecf0 service nova] Creating event network-changed:368b4b69-ee2c-423b-823b-2d0eae43ecae for instance b0ed5413-5513-4b3f-8588-34ba725fff26 on hv-cinder-81966 Aug 30 02:07:03.487302 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-1ccc0938-95b2-47da-9fe5-fbae9ed3eb26 req-cbbd4b0c-6e4a-4805-987e-ef29d835ecf0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041390 Aug 30 02:07:03.488154 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 694/1356] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:04.514549 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1d69aba3-e340-4bb9-9bbe-c4a62785a81e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:04.515087 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1d69aba3-e340-4bb9-9bbe-c4a62785a81e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:04.520979 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d69aba3-e340-4bb9-9bbe-c4a62785a81e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.521455 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d69aba3-e340-4bb9-9bbe-c4a62785a81e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.521880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d69aba3-e340-4bb9-9bbe-c4a62785a81e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.522565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d69aba3-e340-4bb9-9bbe-c4a62785a81e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.523013 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d69aba3-e340-4bb9-9bbe-c4a62785a81e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.523429 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1d69aba3-e340-4bb9-9bbe-c4a62785a81e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.600976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-1d69aba3-e340-4bb9-9bbe-c4a62785a81e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lazy-loading 'services' on Instance uuid b0ed5413-5513-4b3f-8588-34ba725fff26 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:04.679143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1d69aba3-e340-4bb9-9bbe-c4a62785a81e tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments/cac23e6b-f543-4675-916d-c0a0d2edc74e" status: 202 len: 0 microversion: 2.1 time: 0.169035 Aug 30 02:07:04.680204 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 663/1357] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:07:04 2022] DELETE /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments/cac23e6b-f543-4675-916d-c0a0d2edc74e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:04.690951 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-edb88189-7e8d-4b66-a7f7-5c6b006f89cd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:04.693370 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-edb88189-7e8d-4b66-a7f7-5c6b006f89cd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:04.700486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb88189-7e8d-4b66-a7f7-5c6b006f89cd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.701145 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb88189-7e8d-4b66-a7f7-5c6b006f89cd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.701661 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb88189-7e8d-4b66-a7f7-5c6b006f89cd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.702441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb88189-7e8d-4b66-a7f7-5c6b006f89cd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.702971 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb88189-7e8d-4b66-a7f7-5c6b006f89cd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.703468 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-edb88189-7e8d-4b66-a7f7-5c6b006f89cd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.734224 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-edb88189-7e8d-4b66-a7f7-5c6b006f89cd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049442 Aug 30 02:07:04.734802 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 695/1358] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:04 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:05.503402 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-665e49fa-4204-427f-9752-343aca1591d0 req-4739c6af-3038-4bf7-872e-d30e311fb403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ed5413-5513-4b3f-8588-34ba725fff26", "tag": "368b4b69-ee2c-423b-823b-2d0eae43ecae"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:05.513587 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-665e49fa-4204-427f-9752-343aca1591d0 req-4739c6af-3038-4bf7-872e-d30e311fb403 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:05.514059 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-665e49fa-4204-427f-9752-343aca1591d0 req-4739c6af-3038-4bf7-872e-d30e311fb403 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:05.514484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-665e49fa-4204-427f-9752-343aca1591d0 req-4739c6af-3038-4bf7-872e-d30e311fb403 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:05.525538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-665e49fa-4204-427f-9752-343aca1591d0 req-4739c6af-3038-4bf7-872e-d30e311fb403 service nova] Creating event network-changed:368b4b69-ee2c-423b-823b-2d0eae43ecae for instance b0ed5413-5513-4b3f-8588-34ba725fff26 on hv-cinder-81966 Aug 30 02:07:05.530229 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-665e49fa-4204-427f-9752-343aca1591d0 req-4739c6af-3038-4bf7-872e-d30e311fb403 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031562 Aug 30 02:07:05.530785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 664/1359] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:05.749526 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-38aea269-7629-42a5-b6e5-7e533595a733 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:05.752196 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-38aea269-7629-42a5-b6e5-7e533595a733 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:05.759209 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38aea269-7629-42a5-b6e5-7e533595a733 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:05.759696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38aea269-7629-42a5-b6e5-7e533595a733 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:05.760131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38aea269-7629-42a5-b6e5-7e533595a733 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:05.761112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38aea269-7629-42a5-b6e5-7e533595a733 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:05.761568 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38aea269-7629-42a5-b6e5-7e533595a733 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:05.761993 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-38aea269-7629-42a5-b6e5-7e533595a733 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:05.791303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-38aea269-7629-42a5-b6e5-7e533595a733 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047261 Aug 30 02:07:05.791865 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 696/1360] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:05 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:06.804454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ac162f80-1718-4e12-8623-07b4fddc17c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:06.806721 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ac162f80-1718-4e12-8623-07b4fddc17c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:06.812872 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac162f80-1718-4e12-8623-07b4fddc17c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:06.813351 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac162f80-1718-4e12-8623-07b4fddc17c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:06.813783 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac162f80-1718-4e12-8623-07b4fddc17c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:06.814467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac162f80-1718-4e12-8623-07b4fddc17c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:06.814916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac162f80-1718-4e12-8623-07b4fddc17c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:06.815336 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ac162f80-1718-4e12-8623-07b4fddc17c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:06.845566 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ac162f80-1718-4e12-8623-07b4fddc17c5 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045182 Aug 30 02:07:06.846143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 665/1361] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:06 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:07:06.856523 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:06.857023 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:06.863450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:06.863928 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:06.864398 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:06.865082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:06.865532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:06.865954 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:06.939259 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] HTTP exception thrown: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 is not attached to volume cac23e6b-f543-4675-916d-c0a0d2edc74e Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Request method failure captured: Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: DELETE /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments/cac23e6b-f543-4675-916d-c0a0d2edc74e HTTP/1.1 Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW_OZ58tft7I0MXH68bD36W64mrsO1lUp_8NZlU7VU-tmb1YzVpk9Xlhmh6u3wiRKsyiorr5T_Ij5w6jJ2ELZ5c-SI_p68avTllS_W2nPc8xgvlBP1tffsLy_RfkZzmoWiETaatapBOZy75iHOVwsgYzjCLXBNRlvrDaFSRmLTpWY0A Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 7351c123c59146cf80c23e0d1ffe80fb Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-TestMinimumBasicScenario-238626459 Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:07:06.949383 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7351c123c59146cf80c23e0d1ffe80fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7351c123c59146cf80c23e0d1ffe80fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7351c123c59146cf80c23e0d1ffe80fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7351c123c59146cf80c23e0d1ffe80fb"}]}] Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-TestMinimumBasicScenario-238626459 Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 7351c123c59146cf80c23e0d1ffe80fb Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-TestMinimumBasicScenario-238626459 Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-TestMinimumBasicScenario-238626459-project Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 6131a8d2e9374070bc770270c7a70519 Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-TestMinimumBasicScenario-238626459-project Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:07:06.950980 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 is not attached to volume cac23e6b-f543-4675-916d-c0a0d2edc74e Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'server_id': 'b0ed5413-5513-4b3f-8588-34ba725fff26', 'id': 'cac23e6b-f543-4675-916d-c0a0d2edc74e'} Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cac23e6b-f543-4675-916d-c0a0d2edc74e. Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:06.951755 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 is not attached to volume cac23e6b-f543-4675-916d-c0a0d2edc74e Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 is not attached to volume cac23e6b-f543-4675-916d-c0a0d2edc74e Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:06.953420 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Returning 404 to user: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 is not attached to volume cac23e6b-f543-4675-916d-c0a0d2edc74e {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:06.955125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5084252a-a2f9-4748-83fb-28013118da2d tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments/cac23e6b-f543-4675-916d-c0a0d2edc74e" status: 404 len: 154 microversion: 2.1 time: 0.098144 Aug 30 02:07:06.955125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 697/1362] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:07:06 2022] DELETE /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26/os-volume_attachments/cac23e6b-f543-4675-916d-c0a0d2edc74e => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:08.090062 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-778f3dad-deb1-4584-94aa-9c3ba9c279b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:08.090589 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-778f3dad-deb1-4584-94aa-9c3ba9c279b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:08.097009 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-778f3dad-deb1-4584-94aa-9c3ba9c279b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:08.097488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-778f3dad-deb1-4584-94aa-9c3ba9c279b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:08.097925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-778f3dad-deb1-4584-94aa-9c3ba9c279b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:08.098607 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-778f3dad-deb1-4584-94aa-9c3ba9c279b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:08.099054 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-778f3dad-deb1-4584-94aa-9c3ba9c279b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:08.099476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-778f3dad-deb1-4584-94aa-9c3ba9c279b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:08.123877 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-778f3dad-deb1-4584-94aa-9c3ba9c279b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:07:08.197593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-778f3dad-deb1-4584-94aa-9c3ba9c279b3 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 204 len: 0 microversion: 2.1 time: 0.111121 Aug 30 02:07:08.198333 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 666/1363] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:07:08 2022] DELETE /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:07:08.207901 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-85c095a7-7e81-492e-9b81-4fe47a74dadd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:08.208534 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-85c095a7-7e81-492e-9b81-4fe47a74dadd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:08.214869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85c095a7-7e81-492e-9b81-4fe47a74dadd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:08.215349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85c095a7-7e81-492e-9b81-4fe47a74dadd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:08.215775 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85c095a7-7e81-492e-9b81-4fe47a74dadd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:08.216481 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85c095a7-7e81-492e-9b81-4fe47a74dadd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:08.216931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85c095a7-7e81-492e-9b81-4fe47a74dadd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:08.217349 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-85c095a7-7e81-492e-9b81-4fe47a74dadd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:08.348194 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-85c095a7-7e81-492e-9b81-4fe47a74dadd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:08.355660 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-85c095a7-7e81-492e-9b81-4fe47a74dadd tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1554 microversion: 2.1 time: 0.152377 Aug 30 02:07:08.356208 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 698/1364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:08 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:09.378037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2ff03c09-cb88-4870-8887-b06778ed5451 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:09.378768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2ff03c09-cb88-4870-8887-b06778ed5451 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:09.385136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ff03c09-cb88-4870-8887-b06778ed5451 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:09.385909 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ff03c09-cb88-4870-8887-b06778ed5451 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:09.386343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ff03c09-cb88-4870-8887-b06778ed5451 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:09.387027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ff03c09-cb88-4870-8887-b06778ed5451 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:09.387475 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ff03c09-cb88-4870-8887-b06778ed5451 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:09.387895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2ff03c09-cb88-4870-8887-b06778ed5451 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:09.514483 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-2ff03c09-cb88-4870-8887-b06778ed5451 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:09.522698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2ff03c09-cb88-4870-8887-b06778ed5451 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1554 microversion: 2.1 time: 0.149460 Aug 30 02:07:09.523262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 667/1365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:09 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:10.543379 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7368b34d-5047-41ca-94bd-e6c912e9fd32 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:10.544025 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7368b34d-5047-41ca-94bd-e6c912e9fd32 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:10.550350 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7368b34d-5047-41ca-94bd-e6c912e9fd32 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:10.550824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7368b34d-5047-41ca-94bd-e6c912e9fd32 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:10.551247 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7368b34d-5047-41ca-94bd-e6c912e9fd32 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:10.552019 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7368b34d-5047-41ca-94bd-e6c912e9fd32 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:10.552495 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7368b34d-5047-41ca-94bd-e6c912e9fd32 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:10.552909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7368b34d-5047-41ca-94bd-e6c912e9fd32 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:10.676371 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-7368b34d-5047-41ca-94bd-e6c912e9fd32 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:10.683806 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7368b34d-5047-41ca-94bd-e6c912e9fd32 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1554 microversion: 2.1 time: 0.144254 Aug 30 02:07:10.684378 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 699/1366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:10 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1554 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:11.307405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-bb717db3-bf73-4718-a0c7-37a7582244b7 req-96ad00cc-827a-4070-8dc8-522ff27f3011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0ed5413-5513-4b3f-8588-34ba725fff26", "name": "network-vif-deleted", "tag": "368b4b69-ee2c-423b-823b-2d0eae43ecae"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:11.318598 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-bb717db3-bf73-4718-a0c7-37a7582244b7 req-96ad00cc-827a-4070-8dc8-522ff27f3011 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:11.319078 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-bb717db3-bf73-4718-a0c7-37a7582244b7 req-96ad00cc-827a-4070-8dc8-522ff27f3011 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:11.319513 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-bb717db3-bf73-4718-a0c7-37a7582244b7 req-96ad00cc-827a-4070-8dc8-522ff27f3011 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:11.332106 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-bb717db3-bf73-4718-a0c7-37a7582244b7 req-96ad00cc-827a-4070-8dc8-522ff27f3011 service nova] Creating event network-vif-deleted:368b4b69-ee2c-423b-823b-2d0eae43ecae for instance b0ed5413-5513-4b3f-8588-34ba725fff26 on hv-cinder-81966 Aug 30 02:07:11.336777 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-bb717db3-bf73-4718-a0c7-37a7582244b7 req-96ad00cc-827a-4070-8dc8-522ff27f3011 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116360 Aug 30 02:07:11.337342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 668/1367] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:11.704892 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:11.705428 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:11.711721 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:11.712200 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:11.712659 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:11.713343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:11.713787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:11.714207 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:11.744441 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:11.744906 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:11.745332 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:11.745768 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lazy-loading 'fault' on Instance uuid b0ed5413-5513-4b3f-8588-34ba725fff26 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:11.785732 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6131a8d2e9374070bc770270c7a70519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7351c123c59146cf80c23e0d1ffe80fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:11.793082 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-91d71d7a-1491-4faf-8c9a-3e1fc6e25e33 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 200 len: 1348 microversion: 2.1 time: 0.092111 Aug 30 02:07:11.793638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 700/1368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:11 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:12.815804 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:12.816523 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] [instance: b0ed5413-5513-4b3f-8588-34ba725fff26] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:12.822552 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:12.823020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:12.823442 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:12.824113 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:12.824585 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:12.825000 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:12.837747 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] HTTP exception thrown: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 could not be found. Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Request method failure captured: Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 HTTP/1.1 Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW_OZ58tft7I0MXH68bD36W64mrsO1lUp_8NZlU7VU-tmb1YzVpk9Xlhmh6u3wiRKsyiorr5T_Ij5w6jJ2ELZ5c-SI_p68avTllS_W2nPc8xgvlBP1tffsLy_RfkZzmoWiETaatapBOZy75iHOVwsgYzjCLXBNRlvrDaFSRmLTpWY0A Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 7351c123c59146cf80c23e0d1ffe80fb Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-TestMinimumBasicScenario-238626459 Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:07:12.839307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7351c123c59146cf80c23e0d1ffe80fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7351c123c59146cf80c23e0d1ffe80fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7351c123c59146cf80c23e0d1ffe80fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7351c123c59146cf80c23e0d1ffe80fb"}]}] Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-TestMinimumBasicScenario-238626459 Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 7351c123c59146cf80c23e0d1ffe80fb Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-TestMinimumBasicScenario-238626459 Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-TestMinimumBasicScenario-238626459-project Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 6131a8d2e9374070bc770270c7a70519 Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-TestMinimumBasicScenario-238626459-project Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 could not be found. Aug 30 02:07:12.840932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': 'b0ed5413-5513-4b3f-8588-34ba725fff26'} Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 could not be found. Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:12.841778 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 could not be found. Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 could not be found. Aug 30 02:07:12.843242 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:12.844657 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Returning 404 to user: Instance b0ed5413-5513-4b3f-8588-34ba725fff26 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:12.844657 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2f3b9b1b-baab-4404-8c31-16e2266f5e4f tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26" status: 404 len: 111 microversion: 2.1 time: 0.030107 Aug 30 02:07:12.844657 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 669/1369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:12 2022] GET /compute/v2.1/servers/b0ed5413-5513-4b3f-8588-34ba725fff26 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:12.849166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6ab0dc10-71cc-41d9-af1c-d1cc5c0c4881 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] Calling method '.version_select at 0x7f3b03f26040>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:12.867620 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6ab0dc10-71cc-41d9-af1c-d1cc5c0c4881 tempest-TestMinimumBasicScenario-238626459 tempest-TestMinimumBasicScenario-238626459-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-192436992" status: 202 len: 0 microversion: 2.1 time: 0.022244 Aug 30 02:07:12.868170 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 701/1370] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 30 02:07:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-192436992 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:13.465328 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1857c29f-ea59-4b54-946f-2d6cd91a810b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:13.465816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-1857c29f-ea59-4b54-946f-2d6cd91a810b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:13.471624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1857c29f-ea59-4b54-946f-2d6cd91a810b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:13.472101 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1857c29f-ea59-4b54-946f-2d6cd91a810b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:13.472632 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1857c29f-ea59-4b54-946f-2d6cd91a810b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:13.473315 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1857c29f-ea59-4b54-946f-2d6cd91a810b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:13.473761 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1857c29f-ea59-4b54-946f-2d6cd91a810b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:13.474176 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-1857c29f-ea59-4b54-946f-2d6cd91a810b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:13.497127 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1857c29f-ea59-4b54-946f-2d6cd91a810b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/ips" status: 200 len: 145 microversion: 2.1 time: 0.166748 Aug 30 02:07:13.497667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 670/1371] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 02:07:13 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/ips => generated 145 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:14.838153 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-5c249a0f-13e0-40a0-a3ca-9054aa7503aa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b479c168-961a-4830-ab25-6010c2d1b066"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:14.840778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-5c249a0f-13e0-40a0-a3ca-9054aa7503aa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:14.848232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c249a0f-13e0-40a0-a3ca-9054aa7503aa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:14.848943 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c249a0f-13e0-40a0-a3ca-9054aa7503aa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:14.849388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c249a0f-13e0-40a0-a3ca-9054aa7503aa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:14.850096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c249a0f-13e0-40a0-a3ca-9054aa7503aa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:14.850553 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c249a0f-13e0-40a0-a3ca-9054aa7503aa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:14.850984 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-5c249a0f-13e0-40a0-a3ca-9054aa7503aa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:15.161330 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-5c249a0f-13e0-40a0-a3ca-9054aa7503aa tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328038 Aug 30 02:07:15.166778 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 702/1372] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 02:07:14 2022] POST /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:22.706929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-30c5d12f-c4db-41cb-af64-0499eb94bb3e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:22.709188 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-30c5d12f-c4db-41cb-af64-0499eb94bb3e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:22.715735 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30c5d12f-c4db-41cb-af64-0499eb94bb3e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:22.716208 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30c5d12f-c4db-41cb-af64-0499eb94bb3e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:22.716736 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30c5d12f-c4db-41cb-af64-0499eb94bb3e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:22.717413 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30c5d12f-c4db-41cb-af64-0499eb94bb3e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:22.717861 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30c5d12f-c4db-41cb-af64-0499eb94bb3e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:22.718281 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30c5d12f-c4db-41cb-af64-0499eb94bb3e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:22.746911 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-30c5d12f-c4db-41cb-af64-0499eb94bb3e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043818 Aug 30 02:07:22.747443 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 671/1373] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:22 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:22.759502 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ee4012d6-a16a-4635-8b18-71385148dd41 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:22.760074 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-ee4012d6-a16a-4635-8b18-71385148dd41 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:22.766400 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee4012d6-a16a-4635-8b18-71385148dd41 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:22.766870 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee4012d6-a16a-4635-8b18-71385148dd41 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:22.767953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee4012d6-a16a-4635-8b18-71385148dd41 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:22.768668 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee4012d6-a16a-4635-8b18-71385148dd41 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:22.769118 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee4012d6-a16a-4635-8b18-71385148dd41 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:22.769538 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-ee4012d6-a16a-4635-8b18-71385148dd41 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:22.797187 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ee4012d6-a16a-4635-8b18-71385148dd41 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments/b479c168-961a-4830-ab25-6010c2d1b066" status: 200 len: 194 microversion: 2.1 time: 0.042547 Aug 30 02:07:22.797740 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 703/1374] 10.222.0.50 () {58 vars in 1413 bytes} [Tue Aug 30 02:07:22 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments/b479c168-961a-4830-ab25-6010c2d1b066 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:07:24.112871 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c6da9cad-060e-4ff9-a06b-cc208cc0c256 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f252b00-1c97-4534-8872-76cfd28099b2"}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:24.115159 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c6da9cad-060e-4ff9-a06b-cc208cc0c256 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:24.121501 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6da9cad-060e-4ff9-a06b-cc208cc0c256 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:24.121981 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6da9cad-060e-4ff9-a06b-cc208cc0c256 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:24.122415 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6da9cad-060e-4ff9-a06b-cc208cc0c256 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:24.123096 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6da9cad-060e-4ff9-a06b-cc208cc0c256 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:24.123546 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6da9cad-060e-4ff9-a06b-cc208cc0c256 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:24.123965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c6da9cad-060e-4ff9-a06b-cc208cc0c256 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:24.382188 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c6da9cad-060e-4ff9-a06b-cc208cc0c256 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "POST /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273075 Aug 30 02:07:24.383039 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 672/1375] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 02:07:24 2022] POST /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:31.894129 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d3b4b69b-1059-4076-b80e-7a0ad0ece178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:31.897045 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d3b4b69b-1059-4076-b80e-7a0ad0ece178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:31.903308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3b4b69b-1059-4076-b80e-7a0ad0ece178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.903783 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3b4b69b-1059-4076-b80e-7a0ad0ece178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.904214 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3b4b69b-1059-4076-b80e-7a0ad0ece178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:31.904917 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3b4b69b-1059-4076-b80e-7a0ad0ece178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.905363 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3b4b69b-1059-4076-b80e-7a0ad0ece178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.905782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3b4b69b-1059-4076-b80e-7a0ad0ece178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:31.934205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d3b4b69b-1059-4076-b80e-7a0ad0ece178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043973 Aug 30 02:07:31.934733 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 704/1376] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:31 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:32.076851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a5f411f6-0b5e-45da-9f88-51b12fe01357 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:32.077388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a5f411f6-0b5e-45da-9f88-51b12fe01357 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:32.083944 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5f411f6-0b5e-45da-9f88-51b12fe01357 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.084467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5f411f6-0b5e-45da-9f88-51b12fe01357 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.084899 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5f411f6-0b5e-45da-9f88-51b12fe01357 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.085576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5f411f6-0b5e-45da-9f88-51b12fe01357 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.086020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5f411f6-0b5e-45da-9f88-51b12fe01357 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.086436 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a5f411f6-0b5e-45da-9f88-51b12fe01357 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.114250 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a5f411f6-0b5e-45da-9f88-51b12fe01357 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments/b479c168-961a-4830-ab25-6010c2d1b066" status: 200 len: 194 microversion: 2.1 time: 0.041834 Aug 30 02:07:32.115320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 673/1377] 10.222.0.50 () {58 vars in 1413 bytes} [Tue Aug 30 02:07:32 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments/b479c168-961a-4830-ab25-6010c2d1b066 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:32.127378 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d9d2c8d3-e9df-4b34-9b04-950688e7ca64 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:32.128115 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d9d2c8d3-e9df-4b34-9b04-950688e7ca64 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:32.135528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d9d2c8d3-e9df-4b34-9b04-950688e7ca64 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.136582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d9d2c8d3-e9df-4b34-9b04-950688e7ca64 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.137177 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d9d2c8d3-e9df-4b34-9b04-950688e7ca64 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.138205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d9d2c8d3-e9df-4b34-9b04-950688e7ca64 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.138867 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d9d2c8d3-e9df-4b34-9b04-950688e7ca64 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.139298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d9d2c8d3-e9df-4b34-9b04-950688e7ca64 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.218040 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-d9d2c8d3-e9df-4b34-9b04-950688e7ca64 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lazy-loading 'services' on Instance uuid e4fda211-de80-4455-9023-4d02d24482d9 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:32.288269 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d9d2c8d3-e9df-4b34-9b04-950688e7ca64 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments/b479c168-961a-4830-ab25-6010c2d1b066" status: 202 len: 0 microversion: 2.1 time: 0.166228 Aug 30 02:07:32.289356 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 705/1378] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:07:32 2022] DELETE /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments/b479c168-961a-4830-ab25-6010c2d1b066 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:34.463900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a6ccab7b-fd33-471f-b92d-7ab28e0ba925 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:34.464411 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a6ccab7b-fd33-471f-b92d-7ab28e0ba925 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:34.466931 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:34.472559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a6ccab7b-fd33-471f-b92d-7ab28e0ba925 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.473063 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a6ccab7b-fd33-471f-b92d-7ab28e0ba925 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.473490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a6ccab7b-fd33-471f-b92d-7ab28e0ba925 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.474165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a6ccab7b-fd33-471f-b92d-7ab28e0ba925 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.474606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a6ccab7b-fd33-471f-b92d-7ab28e0ba925 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.475022 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a6ccab7b-fd33-471f-b92d-7ab28e0ba925 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.477862 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:34.505727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a6ccab7b-fd33-471f-b92d-7ab28e0ba925 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments/9f252b00-1c97-4534-8872-76cfd28099b2" status: 200 len: 194 microversion: 2.1 time: 0.045774 Aug 30 02:07:34.506878 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 674/1379] 10.222.0.50 () {58 vars in 1413 bytes} [Tue Aug 30 02:07:34 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments/9f252b00-1c97-4534-8872-76cfd28099b2 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:34.518059 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-7384a565-878e-4365-9ba9-74949e83acb6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:34.518639 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-7384a565-878e-4365-9ba9-74949e83acb6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:34.521075 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:34.526514 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7384a565-878e-4365-9ba9-74949e83acb6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.526990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7384a565-878e-4365-9ba9-74949e83acb6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.527425 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7384a565-878e-4365-9ba9-74949e83acb6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.528112 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7384a565-878e-4365-9ba9-74949e83acb6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.528594 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7384a565-878e-4365-9ba9-74949e83acb6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.529020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-7384a565-878e-4365-9ba9-74949e83acb6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.609036 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-7384a565-878e-4365-9ba9-74949e83acb6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lazy-loading 'services' on Instance uuid e4fda211-de80-4455-9023-4d02d24482d9 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:34.677679 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7384a565-878e-4365-9ba9-74949e83acb6 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments/9f252b00-1c97-4534-8872-76cfd28099b2" status: 202 len: 0 microversion: 2.1 time: 0.163681 Aug 30 02:07:34.678836 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 706/1380] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:07:34 2022] DELETE /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments/9f252b00-1c97-4534-8872-76cfd28099b2 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:35.856887 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9e405ba0-acd8-49bb-ab87-ae4e131d5874 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:35.859144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9e405ba0-acd8-49bb-ab87-ae4e131d5874 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:35.866020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e405ba0-acd8-49bb-ab87-ae4e131d5874 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:35.866497 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e405ba0-acd8-49bb-ab87-ae4e131d5874 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:35.866930 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e405ba0-acd8-49bb-ab87-ae4e131d5874 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:35.867611 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e405ba0-acd8-49bb-ab87-ae4e131d5874 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:35.868060 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e405ba0-acd8-49bb-ab87-ae4e131d5874 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:35.868629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9e405ba0-acd8-49bb-ab87-ae4e131d5874 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:35.897358 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9e405ba0-acd8-49bb-ab87-ae4e131d5874 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044410 Aug 30 02:07:35.897887 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 675/1381] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:35 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:07:36.008360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-759e4b00-0aba-44d6-87ac-d2de4ff67bc9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:36.011386 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-759e4b00-0aba-44d6-87ac-d2de4ff67bc9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:36.017465 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-759e4b00-0aba-44d6-87ac-d2de4ff67bc9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:36.017942 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-759e4b00-0aba-44d6-87ac-d2de4ff67bc9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:36.018376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-759e4b00-0aba-44d6-87ac-d2de4ff67bc9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.019064 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-759e4b00-0aba-44d6-87ac-d2de4ff67bc9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:36.019513 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-759e4b00-0aba-44d6-87ac-d2de4ff67bc9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:36.019932 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-759e4b00-0aba-44d6-87ac-d2de4ff67bc9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.022399 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:36.050557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-759e4b00-0aba-44d6-87ac-d2de4ff67bc9 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047041 Aug 30 02:07:36.051096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 707/1382] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:36 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:07:36.111252 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-82ceda87-c6ed-4f56-8f27-54908670bdb3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:36.111746 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-82ceda87-c6ed-4f56-8f27-54908670bdb3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:36.118337 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-82ceda87-c6ed-4f56-8f27-54908670bdb3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:36.118880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-82ceda87-c6ed-4f56-8f27-54908670bdb3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:36.119257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-82ceda87-c6ed-4f56-8f27-54908670bdb3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.119954 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-82ceda87-c6ed-4f56-8f27-54908670bdb3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:36.120435 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-82ceda87-c6ed-4f56-8f27-54908670bdb3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:36.120863 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-82ceda87-c6ed-4f56-8f27-54908670bdb3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.146293 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-82ceda87-c6ed-4f56-8f27-54908670bdb3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:07:36.222236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-82ceda87-c6ed-4f56-8f27-54908670bdb3 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 204 len: 0 microversion: 2.1 time: 0.114390 Aug 30 02:07:36.222893 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 676/1383] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:07:36 2022] DELETE /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:07:36.232597 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-320b9c52-5985-4d92-849a-92c12962c678 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:36.233224 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-320b9c52-5985-4d92-849a-92c12962c678 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:36.239096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-320b9c52-5985-4d92-849a-92c12962c678 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:36.239573 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-320b9c52-5985-4d92-849a-92c12962c678 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:36.240034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-320b9c52-5985-4d92-849a-92c12962c678 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.241353 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-320b9c52-5985-4d92-849a-92c12962c678 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:36.241799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-320b9c52-5985-4d92-849a-92c12962c678 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:36.242224 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-320b9c52-5985-4d92-849a-92c12962c678 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.372616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-320b9c52-5985-4d92-849a-92c12962c678 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:36.380653 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-320b9c52-5985-4d92-849a-92c12962c678 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1673 microversion: 2.1 time: 0.152855 Aug 30 02:07:36.381214 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 708/1384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:36 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:37.403167 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-aab1ea9a-24bb-46c0-8cdb-2e6879bad09b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:37.403867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-aab1ea9a-24bb-46c0-8cdb-2e6879bad09b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:37.410335 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aab1ea9a-24bb-46c0-8cdb-2e6879bad09b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:37.410825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aab1ea9a-24bb-46c0-8cdb-2e6879bad09b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:37.411264 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aab1ea9a-24bb-46c0-8cdb-2e6879bad09b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:37.411955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aab1ea9a-24bb-46c0-8cdb-2e6879bad09b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:37.412471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aab1ea9a-24bb-46c0-8cdb-2e6879bad09b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:37.412900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-aab1ea9a-24bb-46c0-8cdb-2e6879bad09b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:37.544012 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-aab1ea9a-24bb-46c0-8cdb-2e6879bad09b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:37.551781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-aab1ea9a-24bb-46c0-8cdb-2e6879bad09b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1673 microversion: 2.1 time: 0.152816 Aug 30 02:07:37.552287 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 677/1385] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:37 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:38.573934 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f739e6e2-f209-4b8d-888b-17990177ae8e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:38.574663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f739e6e2-f209-4b8d-888b-17990177ae8e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:38.580943 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f739e6e2-f209-4b8d-888b-17990177ae8e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:38.581460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f739e6e2-f209-4b8d-888b-17990177ae8e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:38.581893 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f739e6e2-f209-4b8d-888b-17990177ae8e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:38.582583 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f739e6e2-f209-4b8d-888b-17990177ae8e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:38.583030 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f739e6e2-f209-4b8d-888b-17990177ae8e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:38.583453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f739e6e2-f209-4b8d-888b-17990177ae8e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:38.807283 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-f739e6e2-f209-4b8d-888b-17990177ae8e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:38.814794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f739e6e2-f209-4b8d-888b-17990177ae8e tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1673 microversion: 2.1 time: 0.244727 Aug 30 02:07:38.815360 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 709/1386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:38 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1673 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:39.551580 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-5f8351b7-eef7-455c-a982-e7ccf89e07e4 req-0834913f-5cc9-4af5-8f8a-bcae65740761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fda211-de80-4455-9023-4d02d24482d9", "name": "network-vif-deleted", "tag": "62afbf44-256a-4d44-b575-d190b4c34917"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:39.561927 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5f8351b7-eef7-455c-a982-e7ccf89e07e4 req-0834913f-5cc9-4af5-8f8a-bcae65740761 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:39.562405 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5f8351b7-eef7-455c-a982-e7ccf89e07e4 req-0834913f-5cc9-4af5-8f8a-bcae65740761 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:39.562830 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-5f8351b7-eef7-455c-a982-e7ccf89e07e4 req-0834913f-5cc9-4af5-8f8a-bcae65740761 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:39.574058 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-5f8351b7-eef7-455c-a982-e7ccf89e07e4 req-0834913f-5cc9-4af5-8f8a-bcae65740761 service nova] Creating event network-vif-deleted:62afbf44-256a-4d44-b575-d190b4c34917 for instance e4fda211-de80-4455-9023-4d02d24482d9 on hv-cinder-81966 Aug 30 02:07:39.579681 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-5f8351b7-eef7-455c-a982-e7ccf89e07e4 req-0834913f-5cc9-4af5-8f8a-bcae65740761 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031595 Aug 30 02:07:39.580471 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 678/1387] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:39.836032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:39.836712 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:39.843312 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:39.844039 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:39.844500 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:39.845223 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:39.845674 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:39.846096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:39.875998 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:39.876513 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:39.876942 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:39.877376 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lazy-loading 'fault' on Instance uuid e4fda211-de80-4455-9023-4d02d24482d9 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:39.918856 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fcefa4a0db4bd6a051b1446e1a0d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f06a31df841b89ed6874d20340475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:39.926537 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-520fa956-0744-47a7-b455-ffc748b51178 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 200 len: 1327 microversion: 2.1 time: 0.095548 Aug 30 02:07:39.927104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 710/1388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:39 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:40.948982 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:40.949595 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:40.956130 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:40.956665 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:40.957101 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:40.957785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:40.958237 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:40.958661 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:40.972216 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] HTTP exception thrown: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Request method failure captured: Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 HTTP/1.1 Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4aEGGc3qQXi6Sw2tM7wlB2sHMzDPZSPC9XnUwy1pmJWqX6dmIq8Wu0CUU5OpOeUildq7CRzbza2aV7cZpm5NXnBXWoyON4w-Vg3ze-jR8rq5kityYVrYTVFJaeDScEWT1t726QznTpEk-4OgazQ6rG2oM1wloX0BzO4iuLQJw_034 Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:07:40.973824 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f90f06a31df841b89ed6874d20340475"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f90f06a31df841b89ed6874d20340475"}]}] Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 68fcefa4a0db4bd6a051b1446e1a0d2d Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:40.976102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': 'e4fda211-de80-4455-9023-4d02d24482d9'} Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:40.977073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:40.978667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.980076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Returning 404 to user: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:40.980076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-87ad6bf2-4f66-45d2-a277-59c40db84e3d tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 404 len: 111 microversion: 2.1 time: 0.031641 Aug 30 02:07:40.980076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 679/1389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:40 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:40.984498 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d23c23de-90fa-487d-8674-df8ca4551d1f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '.version_select at 0x7f3b0b8681f0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:41.002560 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d23c23de-90fa-487d-8674-df8ca4551d1f tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615322121" status: 202 len: 0 microversion: 2.1 time: 0.021773 Aug 30 02:07:41.003105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 711/1390] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 02:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615322121 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:43.852609 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:43.853105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:43.859403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:43.859880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:43.860344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:43.861029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:43.861478 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:43.861900 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:43.875694 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] HTTP exception thrown: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Request method failure captured: Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 HTTP/1.1 Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4aEGGc3qQXi6Sw2tM7wlB2sHMzDPZSPC9XnUwy1pmJWqX6dmIq8Wu0CUU5OpOeUildq7CRzbza2aV7cZpm5NXnBXWoyON4w-Vg3ze-jR8rq5kityYVrYTVFJaeDScEWT1t726QznTpEk-4OgazQ6rG2oM1wloX0BzO4iuLQJw_034 Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:07:43.877235 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f90f06a31df841b89ed6874d20340475"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f90f06a31df841b89ed6874d20340475"}]}] Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 68fcefa4a0db4bd6a051b1446e1a0d2d Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:43.878750 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': 'e4fda211-de80-4455-9023-4d02d24482d9'} Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:43.879507 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:43.880785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:43.882441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Returning 404 to user: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:43.882441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-0e4826ed-90a0-4561-96ea-089aaba96584 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 404 len: 111 microversion: 2.1 time: 0.030380 Aug 30 02:07:43.882441 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 680/1391] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:07:43 2022] DELETE /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:43.887714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:43.888361 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: e4fda211-de80-4455-9023-4d02d24482d9] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:43.895387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:43.895868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:43.896325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:43.897033 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:43.897484 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:43.897908 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:43.910681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] HTTP exception thrown: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Request method failure captured: Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 HTTP/1.1 Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4aEGGc3qQXi6Sw2tM7wlB2sHMzDPZSPC9XnUwy1pmJWqX6dmIq8Wu0CUU5OpOeUildq7CRzbza2aV7cZpm5NXnBXWoyON4w-Vg3ze-jR8rq5kityYVrYTVFJaeDScEWT1t726QznTpEk-4OgazQ6rG2oM1wloX0BzO4iuLQJw_034 Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:07:43.912847 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f90f06a31df841b89ed6874d20340475"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f90f06a31df841b89ed6874d20340475"}]}] Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 68fcefa4a0db4bd6a051b1446e1a0d2d Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:43.914610 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': 'e4fda211-de80-4455-9023-4d02d24482d9'} Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:43.915638 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. Aug 30 02:07:43.917280 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:43.918566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Returning 404 to user: Instance e4fda211-de80-4455-9023-4d02d24482d9 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:43.918566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d3abaa49-b8d4-40ed-8ec3-0a99ca15143b tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9" status: 404 len: 111 microversion: 2.1 time: 0.030647 Aug 30 02:07:43.918566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 712/1392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:43 2022] GET /compute/v2.1/servers/e4fda211-de80-4455-9023-4d02d24482d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:45.056015 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:45.056567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:45.063082 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:45.063565 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:45.063998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:45.064785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:45.065238 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:45.065662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:45.078963 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] HTTP exception thrown: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Request method failure captured: Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b HTTP/1.1 Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4aEGGc3qQXi6Sw2tM7wlB2sHMzDPZSPC9XnUwy1pmJWqX6dmIq8Wu0CUU5OpOeUildq7CRzbza2aV7cZpm5NXnBXWoyON4w-Vg3ze-jR8rq5kityYVrYTVFJaeDScEWT1t726QznTpEk-4OgazQ6rG2oM1wloX0BzO4iuLQJw_034 Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:07:45.080541 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f90f06a31df841b89ed6874d20340475"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f90f06a31df841b89ed6874d20340475"}]}] Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 68fcefa4a0db4bd6a051b1446e1a0d2d Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:07:45.082117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '1cf13980-f99e-4a83-9ec5-95e80147696b'} Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:45.083002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:07:45.084538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:07:45.086093 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Returning 404 to user: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:45.086093 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e6fec0b2-e431-4261-a221-d639c8027dcb tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 404 len: 111 microversion: 2.1 time: 0.030378 Aug 30 02:07:45.086093 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 681/1393] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:07:45 2022] DELETE /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:45.090476 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:45.091089 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] [instance: 1cf13980-f99e-4a83-9ec5-95e80147696b] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:45.097639 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:45.098119 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:45.098562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:45.099253 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:45.100203 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:45.100664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:45.113569 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] HTTP exception thrown: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Request method failure captured: Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b HTTP/1.1 Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4aEGGc3qQXi6Sw2tM7wlB2sHMzDPZSPC9XnUwy1pmJWqX6dmIq8Wu0CUU5OpOeUildq7CRzbza2aV7cZpm5NXnBXWoyON4w-Vg3ze-jR8rq5kityYVrYTVFJaeDScEWT1t726QznTpEk-4OgazQ6rG2oM1wloX0BzO4iuLQJw_034 Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:07:45.115051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f90f06a31df841b89ed6874d20340475"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f90f06a31df841b89ed6874d20340475"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f90f06a31df841b89ed6874d20340475"}]}] Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: f90f06a31df841b89ed6874d20340475 Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1873296123 Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 68fcefa4a0db4bd6a051b1446e1a0d2d Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeTestJSON-1873296123-project Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:07:45.117308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '1cf13980-f99e-4a83-9ec5-95e80147696b'} Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:45.118189 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. Aug 30 02:07:45.119630 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:07:45.121005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] Returning 404 to user: Instance 1cf13980-f99e-4a83-9ec5-95e80147696b could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:45.121005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d287a3da-a7e2-4c0d-9d96-6646c71130a0 tempest-AttachVolumeTestJSON-1873296123 tempest-AttachVolumeTestJSON-1873296123-project] 10.222.0.50 "GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b" status: 404 len: 111 microversion: 2.1 time: 0.030448 Aug 30 02:07:45.121005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 713/1394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:45 2022] GET /compute/v2.1/servers/1cf13980-f99e-4a83-9ec5-95e80147696b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:50.789157 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-20f60644-5707-45ff-a919-fe82bdb4814b tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b0b7ecb80>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:50.836593 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-20f60644-5707-45ff-a919-fe82bdb4814b tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/78ec8ada-f07a-4deb-b3b9-15e32ce7d88f" status: 200 len: 350 microversion: 2.1 time: 0.051183 Aug 30 02:07:50.837143 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 682/1395] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 02:07:50 2022] GET /compute/v2.1/os-volumes/78ec8ada-f07a-4deb-b3b9-15e32ce7d88f => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:56.378799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d123728c-5c40-4da1-8775-849786412431 tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b08206ee0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:56.383103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:56.384274 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:56.387139 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:56.387995 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=29 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:56.388875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2117707689", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2051291069", "security_groups": [{"name": "tempest-secgroup-smoke-83394517"}], "block_device_mapping_v2": [{"uuid": "9bd76d6d-db97-4851-8eae-9f35ce0e891c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6493208c-2d03-4273-9fca-307a3c4e68fa"}]}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:56.432090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d123728c-5c40-4da1-8775-849786412431 tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/57b7e849-c94c-42fa-b935-9ae477a759e3" status: 200 len: 351 microversion: 2.1 time: 0.057187 Aug 30 02:07:56.432674 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 714/1396] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 02:07:56 2022] GET /compute/v2.1/os-volumes/57b7e849-c94c-42fa-b935-9ae477a759e3 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:56.511331 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.network.neutron [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] validate_networks() for [('6493208c-2d03-4273-9fca-307a3c4e68fa', None, None, None, None, None)] {{(pid=120392) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:07:56.886226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Flavor limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:07:56.886698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Image limits 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:07:56.887162 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Flavor pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:07:56.887567 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Image pref 0:0:0 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:07:56.887990 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.virt.hardware [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:07:56.897165 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:56.897635 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:56.898057 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:56.898768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:56.899214 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:56.899627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:56.916130 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Getting quotas for project 74610e8b7b4d4fafa0e49ba73b94aa48. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:07:56.920004 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.quota [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Getting quotas for user bd08361520db465bb9069326d03d0307 and project 74610e8b7b4d4fafa0e49ba73b94aa48. Resources: {'ram', 'cores', 'instances'} {{(pid=120392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:07:56.979745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Going to run 1 instances... {{(pid=120392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:07:56.981926 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9bd76d6d-db97-4851-8eae-9f35ce0e891c',volume_size=None,volume_type=None)] {{(pid=120392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:07:57.109271 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ca81f9ab-0fcf-450e-af3c-ffd10768ebce tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.727411 Aug 30 02:07:57.109895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 683/1397] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 30 02:07:56 2022] POST /compute/v2.1/servers => generated 404 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 02:07:57.121341 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-15a3b2ae-db46-4edb-931d-c0c07856ac7c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:57.122104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-15a3b2ae-db46-4edb-931d-c0c07856ac7c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:57.176262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-15a3b2ae-db46-4edb-931d-c0c07856ac7c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:57.184736 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-15a3b2ae-db46-4edb-931d-c0c07856ac7c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1095 microversion: 2.1 time: 0.067304 Aug 30 02:07:57.185351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 715/1398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:57 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:57.772553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-951f85bb-8788-4cc0-aae1-ce86f875f322 tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b0804cc10>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:57.821599 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-951f85bb-8788-4cc0-aae1-ce86f875f322 tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/68e8014d-8fbc-4b17-a216-ea8d54ab218e" status: 200 len: 350 microversion: 2.1 time: 0.053829 Aug 30 02:07:57.822163 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 684/1399] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 02:07:57 2022] GET /compute/v2.1/os-volumes/68e8014d-8fbc-4b17-a216-ea8d54ab218e => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:57.835087 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2fe782d3-cb1d-4f40-ae4a-fb0650b0a599 tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b0b868160>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:57.917342 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2fe782d3-cb1d-4f40-ae4a-fb0650b0a599 tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086601 Aug 30 02:07:57.917964 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 716/1400] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Aug 30 02:07:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:57.932223 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-469aa4b8-6805-4cd7-90e2-609283315855 tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b0804c5e0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:58.014815 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-469aa4b8-6805-4cd7-90e2-609283315855 tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086886 Aug 30 02:07:58.015376 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 685/1401] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 30 02:07:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:58.028473 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0e8fdd23-efb0-44d0-bb19-362b45e098ee tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b083744c0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:58.111801 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0e8fdd23-efb0-44d0-bb19-362b45e098ee tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087111 Aug 30 02:07:58.112387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 717/1402] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Aug 30 02:07:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:58.125315 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-052557ff-1fe5-4d92-ae5a-cf9885984d8c tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b0b7ec1f0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:58.205307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-2a7b6891-b5f0-477f-bd90-00130233d311 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:58.205662 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-2a7b6891-b5f0-477f-bd90-00130233d311 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:58.208262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-052557ff-1fe5-4d92-ae5a-cf9885984d8c tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086575 Aug 30 02:07:58.209039 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 686/1403] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 30 02:07:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:58.218725 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2a7b6891-b5f0-477f-bd90-00130233d311 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:58.218725 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2a7b6891-b5f0-477f-bd90-00130233d311 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:58.218725 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2a7b6891-b5f0-477f-bd90-00130233d311 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:58.218725 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2a7b6891-b5f0-477f-bd90-00130233d311 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:58.219109 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2a7b6891-b5f0-477f-bd90-00130233d311 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:58.219109 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-2a7b6891-b5f0-477f-bd90-00130233d311 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:58.224212 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a0e686be-dd8a-4f38-b1f5-cad47a42a84d tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b0b83ec10>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:58.293193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-2a7b6891-b5f0-477f-bd90-00130233d311 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:58.302218 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-2a7b6891-b5f0-477f-bd90-00130233d311 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1193 microversion: 2.1 time: 0.100871 Aug 30 02:07:58.303387 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 718/1404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:58 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:58.325431 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a0e686be-dd8a-4f38-b1f5-cad47a42a84d tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.104760 Aug 30 02:07:58.325987 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 687/1405] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 30 02:07:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:58.339632 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e5c7354e-9a29-4ddb-bfdd-955550e5c4fb tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b0b868b80>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:58.425497 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e5c7354e-9a29-4ddb-bfdd-955550e5c4fb tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089660 Aug 30 02:07:58.426062 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 719/1406] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 02:07:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:58.438995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-84c5ffd0-4776-4431-ac17-f98df0074e51 tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b0802b4c0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:58.527549 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-84c5ffd0-4776-4431-ac17-f98df0074e51 tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092212 Aug 30 02:07:58.528193 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 688/1407] 10.222.0.50 () {58 vars in 1188 bytes} [Tue Aug 30 02:07:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:58.543076 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a351be9e-d04f-4d61-97f2-1b696fc8fd4d tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] Calling method '.version_select at 0x7f3b08336a60>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:58.627681 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a351be9e-d04f-4d61-97f2-1b696fc8fd4d tempest-VolumesTestJSON-1316894626 tempest-VolumesTestJSON-1316894626-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088610 Aug 30 02:07:58.628730 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 720/1408] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 30 02:07:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:59.323794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-cbea94de-632b-436c-828c-1ef5284c2924 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:59.324576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-cbea94de-632b-436c-828c-1ef5284c2924 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:59.331522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea94de-632b-436c-828c-1ef5284c2924 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:59.332429 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea94de-632b-436c-828c-1ef5284c2924 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:59.333037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea94de-632b-436c-828c-1ef5284c2924 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:59.333985 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea94de-632b-436c-828c-1ef5284c2924 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:59.334544 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea94de-632b-436c-828c-1ef5284c2924 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:59.335039 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-cbea94de-632b-436c-828c-1ef5284c2924 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:59.472831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-cbea94de-632b-436c-828c-1ef5284c2924 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:59.481280 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-cbea94de-632b-436c-828c-1ef5284c2924 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.162168 Aug 30 02:07:59.483443 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 689/1409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:59 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:59.673198 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-6c53baa3-3256-4411-b8e3-4f87b9b76216 req-d162bd5f-7559-4fac-8463-1585337cbb0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abbdd816-5a15-4bae-8a89-db3311a05834", "tag": "fa395eb0-fc02-438c-bfe1-12e3122b63fb"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:59.682871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-6c53baa3-3256-4411-b8e3-4f87b9b76216 req-d162bd5f-7559-4fac-8463-1585337cbb0e service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:59.683358 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-6c53baa3-3256-4411-b8e3-4f87b9b76216 req-d162bd5f-7559-4fac-8463-1585337cbb0e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:59.683787 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-6c53baa3-3256-4411-b8e3-4f87b9b76216 req-d162bd5f-7559-4fac-8463-1585337cbb0e service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:59.694581 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-6c53baa3-3256-4411-b8e3-4f87b9b76216 req-d162bd5f-7559-4fac-8463-1585337cbb0e service nova] Creating event network-changed:fa395eb0-fc02-438c-bfe1-12e3122b63fb for instance abbdd816-5a15-4bae-8a89-db3311a05834 on hv-cinder-81966 Aug 30 02:07:59.699453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-6c53baa3-3256-4411-b8e3-4f87b9b76216 req-d162bd5f-7559-4fac-8463-1585337cbb0e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031165 Aug 30 02:07:59.700160 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 721/1410] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:08:00.504070 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-32bea22d-58ba-46d3-af7c-832f2880070f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:00.504709 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-32bea22d-58ba-46d3-af7c-832f2880070f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:00.511830 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32bea22d-58ba-46d3-af7c-832f2880070f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:00.512357 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32bea22d-58ba-46d3-af7c-832f2880070f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:00.512768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32bea22d-58ba-46d3-af7c-832f2880070f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:00.513453 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32bea22d-58ba-46d3-af7c-832f2880070f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:00.513898 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32bea22d-58ba-46d3-af7c-832f2880070f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:00.514343 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-32bea22d-58ba-46d3-af7c-832f2880070f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:00.644144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-32bea22d-58ba-46d3-af7c-832f2880070f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:00.651790 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-32bea22d-58ba-46d3-af7c-832f2880070f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.151585 Aug 30 02:08:00.652372 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 690/1411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:00 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:01.673378 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9f51d705-abd0-44b5-ae9f-b28a9336f8a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:01.674073 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-9f51d705-abd0-44b5-ae9f-b28a9336f8a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:01.680264 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f51d705-abd0-44b5-ae9f-b28a9336f8a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:01.680758 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f51d705-abd0-44b5-ae9f-b28a9336f8a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:01.681192 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f51d705-abd0-44b5-ae9f-b28a9336f8a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:01.681872 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f51d705-abd0-44b5-ae9f-b28a9336f8a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:01.682321 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f51d705-abd0-44b5-ae9f-b28a9336f8a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:01.682749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-9f51d705-abd0-44b5-ae9f-b28a9336f8a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:01.888977 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-9f51d705-abd0-44b5-ae9f-b28a9336f8a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:01.896608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9f51d705-abd0-44b5-ae9f-b28a9336f8a5 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.228080 Aug 30 02:08:01.897794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 722/1412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:01 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:02.917700 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-c9a499a3-bd9e-4ab6-b03a-c8bea50990da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:02.918310 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-c9a499a3-bd9e-4ab6-b03a-c8bea50990da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:02.924822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a499a3-bd9e-4ab6-b03a-c8bea50990da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:02.925297 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a499a3-bd9e-4ab6-b03a-c8bea50990da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:02.925725 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a499a3-bd9e-4ab6-b03a-c8bea50990da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:02.926406 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a499a3-bd9e-4ab6-b03a-c8bea50990da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:02.926852 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a499a3-bd9e-4ab6-b03a-c8bea50990da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:02.927266 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-c9a499a3-bd9e-4ab6-b03a-c8bea50990da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:03.068053 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-c9a499a3-bd9e-4ab6-b03a-c8bea50990da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:03.076426 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-c9a499a3-bd9e-4ab6-b03a-c8bea50990da tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.162491 Aug 30 02:08:03.077713 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 691/1413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:02 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:04.097655 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3f941d69-92e6-4287-bed8-5bfd41b8c15f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:04.098279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3f941d69-92e6-4287-bed8-5bfd41b8c15f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:04.105107 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3f941d69-92e6-4287-bed8-5bfd41b8c15f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:04.105723 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3f941d69-92e6-4287-bed8-5bfd41b8c15f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:04.106026 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3f941d69-92e6-4287-bed8-5bfd41b8c15f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:04.106759 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3f941d69-92e6-4287-bed8-5bfd41b8c15f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:04.107212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3f941d69-92e6-4287-bed8-5bfd41b8c15f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:04.107644 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3f941d69-92e6-4287-bed8-5bfd41b8c15f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:04.240824 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3f941d69-92e6-4287-bed8-5bfd41b8c15f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:04.248435 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3f941d69-92e6-4287-bed8-5bfd41b8c15f tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.154628 Aug 30 02:08:04.248996 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 723/1414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:04 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:05.269657 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-28cfe489-439c-486f-a0a0-522586da4130 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:05.270261 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-28cfe489-439c-486f-a0a0-522586da4130 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:05.276906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28cfe489-439c-486f-a0a0-522586da4130 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:05.277390 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28cfe489-439c-486f-a0a0-522586da4130 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:05.277820 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28cfe489-439c-486f-a0a0-522586da4130 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:05.278509 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28cfe489-439c-486f-a0a0-522586da4130 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:05.278957 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28cfe489-439c-486f-a0a0-522586da4130 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:05.279377 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-28cfe489-439c-486f-a0a0-522586da4130 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:05.478611 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-28cfe489-439c-486f-a0a0-522586da4130 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:05.486252 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-28cfe489-439c-486f-a0a0-522586da4130 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.220492 Aug 30 02:08:05.486808 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 692/1415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:05 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:06.509213 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ca2259fd-1fee-4f2e-8d08-015edd4b5b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:06.510369 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-ca2259fd-1fee-4f2e-8d08-015edd4b5b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:06.510738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a260c302-c1d2-43e5-936a-f52aa80f2c04 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:06.512090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a260c302-c1d2-43e5-936a-f52aa80f2c04 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:06.520008 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca2259fd-1fee-4f2e-8d08-015edd4b5b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:06.521063 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca2259fd-1fee-4f2e-8d08-015edd4b5b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:06.522491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca2259fd-1fee-4f2e-8d08-015edd4b5b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.523381 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca2259fd-1fee-4f2e-8d08-015edd4b5b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:06.524029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca2259fd-1fee-4f2e-8d08-015edd4b5b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:06.524766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-ca2259fd-1fee-4f2e-8d08-015edd4b5b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.525397 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a260c302-c1d2-43e5-936a-f52aa80f2c04 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:06.526049 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a260c302-c1d2-43e5-936a-f52aa80f2c04 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:06.526657 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a260c302-c1d2-43e5-936a-f52aa80f2c04 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.527991 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a260c302-c1d2-43e5-936a-f52aa80f2c04 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:06.528840 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a260c302-c1d2-43e5-936a-f52aa80f2c04 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:06.529428 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a260c302-c1d2-43e5-936a-f52aa80f2c04 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.552116 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ca2259fd-1fee-4f2e-8d08-015edd4b5b59 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/ips" status: 200 len: 148 microversion: 2.1 time: 0.047812 Aug 30 02:08:06.552810 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 693/1416] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 02:08:06 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:08:06.690434 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-a260c302-c1d2-43e5-936a-f52aa80f2c04 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:06.699437 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a260c302-c1d2-43e5-936a-f52aa80f2c04 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.195704 Aug 30 02:08:06.700361 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 724/1417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:06 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:07.722327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-07cb5883-675e-455c-a512-e42bc2f9104b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:07.723221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-07cb5883-675e-455c-a512-e42bc2f9104b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:07.725323 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=2 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:07.725964 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell0:SELECT=6 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:07.732419 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07cb5883-675e-455c-a512-e42bc2f9104b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:07.732895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07cb5883-675e-455c-a512-e42bc2f9104b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:07.733320 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07cb5883-675e-455c-a512-e42bc2f9104b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:07.734004 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07cb5883-675e-455c-a512-e42bc2f9104b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:07.734450 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07cb5883-675e-455c-a512-e42bc2f9104b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:07.734867 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07cb5883-675e-455c-a512-e42bc2f9104b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:07.872301 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-07cb5883-675e-455c-a512-e42bc2f9104b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:07.880307 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-07cb5883-675e-455c-a512-e42bc2f9104b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.162209 Aug 30 02:08:07.894048 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 694/1418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:07 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:07.922310 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a014d405-54e0-4152-b452-8b1d8fab1972 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "996ea2ac-4da0-49e2-87c9-45b05bbfaeac"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:07.924651 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a014d405-54e0-4152-b452-8b1d8fab1972 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:07.926578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell0:SELECT=2 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:07.932976 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a014d405-54e0-4152-b452-8b1d8fab1972 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:07.933456 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a014d405-54e0-4152-b452-8b1d8fab1972 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:07.933888 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a014d405-54e0-4152-b452-8b1d8fab1972 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:07.934580 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a014d405-54e0-4152-b452-8b1d8fab1972 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:07.935030 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a014d405-54e0-4152-b452-8b1d8fab1972 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:07.935582 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a014d405-54e0-4152-b452-8b1d8fab1972 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:08.222831 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a014d405-54e0-4152-b452-8b1d8fab1972 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "POST /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304221 Aug 30 02:08:08.223717 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 725/1419] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 30 02:08:07 2022] POST /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:08.902590 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-7002bc01-33c1-499e-b563-3fa88f224124 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:08.903195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-7002bc01-33c1-499e-b563-3fa88f224124 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:08.909985 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7002bc01-33c1-499e-b563-3fa88f224124 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:08.910474 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7002bc01-33c1-499e-b563-3fa88f224124 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:08.910907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7002bc01-33c1-499e-b563-3fa88f224124 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:08.911606 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7002bc01-33c1-499e-b563-3fa88f224124 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:08.912089 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7002bc01-33c1-499e-b563-3fa88f224124 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:08.912542 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-7002bc01-33c1-499e-b563-3fa88f224124 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:09.072282 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-7002bc01-33c1-499e-b563-3fa88f224124 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:09.086722 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-7002bc01-33c1-499e-b563-3fa88f224124 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.187985 Aug 30 02:08:09.087524 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 695/1420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:08 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:10.107845 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8695d754-8ef7-4ec2-8f3c-eeb62d3684cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:10.108636 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8695d754-8ef7-4ec2-8f3c-eeb62d3684cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:10.114618 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8695d754-8ef7-4ec2-8f3c-eeb62d3684cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:10.115090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8695d754-8ef7-4ec2-8f3c-eeb62d3684cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:10.116010 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8695d754-8ef7-4ec2-8f3c-eeb62d3684cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:10.119169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8695d754-8ef7-4ec2-8f3c-eeb62d3684cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:10.119169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8695d754-8ef7-4ec2-8f3c-eeb62d3684cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:10.119169 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8695d754-8ef7-4ec2-8f3c-eeb62d3684cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:10.510624 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-8695d754-8ef7-4ec2-8f3c-eeb62d3684cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:10.518519 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8695d754-8ef7-4ec2-8f3c-eeb62d3684cb tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.415242 Aug 30 02:08:10.519417 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 726/1421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:10 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:11.539983 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f7a59fed-dbec-46ef-8cde-04797cb13ac2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:11.540692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-f7a59fed-dbec-46ef-8cde-04797cb13ac2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:11.547356 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7a59fed-dbec-46ef-8cde-04797cb13ac2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:11.547919 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7a59fed-dbec-46ef-8cde-04797cb13ac2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:11.548464 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7a59fed-dbec-46ef-8cde-04797cb13ac2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:11.549206 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7a59fed-dbec-46ef-8cde-04797cb13ac2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:11.549653 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7a59fed-dbec-46ef-8cde-04797cb13ac2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:11.550081 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-f7a59fed-dbec-46ef-8cde-04797cb13ac2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:11.685029 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-f7a59fed-dbec-46ef-8cde-04797cb13ac2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:11.692956 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f7a59fed-dbec-46ef-8cde-04797cb13ac2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.157897 Aug 30 02:08:11.693512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 696/1422] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:11 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:12.715275 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-74649d3d-4d09-480e-b670-2cc8cdc0138c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:12.716490 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-74649d3d-4d09-480e-b670-2cc8cdc0138c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:12.721585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 02:08:12.721792 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Tue Aug 30 02:08:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 (ip 10.222.0.50) !!! Aug 30 02:08:12.729921 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74649d3d-4d09-480e-b670-2cc8cdc0138c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:12.730092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-d7894234-1ed2-40d4-b65e-6b0d78565a29 req-b07be243-1331-481c-a2a4-784ccb068ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbdd816-5a15-4bae-8a89-db3311a05834", "name": "network-vif-plugged", "status": "completed", "tag": "fa395eb0-fc02-438c-bfe1-12e3122b63fb"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:12.731255 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74649d3d-4d09-480e-b670-2cc8cdc0138c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:12.731853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74649d3d-4d09-480e-b670-2cc8cdc0138c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:12.732708 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74649d3d-4d09-480e-b670-2cc8cdc0138c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:12.733052 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74649d3d-4d09-480e-b670-2cc8cdc0138c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:12.733480 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-74649d3d-4d09-480e-b670-2cc8cdc0138c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:12.751292 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-d7894234-1ed2-40d4-b65e-6b0d78565a29 req-b07be243-1331-481c-a2a4-784ccb068ba3 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:12.754755 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-d7894234-1ed2-40d4-b65e-6b0d78565a29 req-b07be243-1331-481c-a2a4-784ccb068ba3 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:12.755715 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-d7894234-1ed2-40d4-b65e-6b0d78565a29 req-b07be243-1331-481c-a2a4-784ccb068ba3 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:12.780751 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-d7894234-1ed2-40d4-b65e-6b0d78565a29 req-b07be243-1331-481c-a2a4-784ccb068ba3 service nova] Creating event network-vif-plugged:fa395eb0-fc02-438c-bfe1-12e3122b63fb for instance abbdd816-5a15-4bae-8a89-db3311a05834 on hv-cinder-81966 Aug 30 02:08:12.786196 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-d7894234-1ed2-40d4-b65e-6b0d78565a29 req-b07be243-1331-481c-a2a4-784ccb068ba3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073596 Aug 30 02:08:12.787605 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 697/1423] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:12.873031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-74649d3d-4d09-480e-b670-2cc8cdc0138c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:12.880801 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-74649d3d-4d09-480e-b670-2cc8cdc0138c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.171391 Aug 30 02:08:12.881381 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 727/1424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:12 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:13.901818 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-fcc68f56-08d6-493d-b074-6906ce34d36d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:13.902523 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-fcc68f56-08d6-493d-b074-6906ce34d36d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:13.908698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fcc68f56-08d6-493d-b074-6906ce34d36d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:13.909178 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fcc68f56-08d6-493d-b074-6906ce34d36d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:13.909613 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fcc68f56-08d6-493d-b074-6906ce34d36d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:13.910306 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fcc68f56-08d6-493d-b074-6906ce34d36d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:13.910761 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fcc68f56-08d6-493d-b074-6906ce34d36d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:13.911184 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-fcc68f56-08d6-493d-b074-6906ce34d36d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:14.039254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-fcc68f56-08d6-493d-b074-6906ce34d36d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:14.046937 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-fcc68f56-08d6-493d-b074-6906ce34d36d tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.149930 Aug 30 02:08:14.047498 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 698/1425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:13 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:14.853585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a9888f7f-1aa6-4596-9690-182273d2eb3e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:14.855853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a9888f7f-1aa6-4596-9690-182273d2eb3e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:14.862299 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a9888f7f-1aa6-4596-9690-182273d2eb3e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:14.862731 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a9888f7f-1aa6-4596-9690-182273d2eb3e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:14.863145 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a9888f7f-1aa6-4596-9690-182273d2eb3e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:14.863823 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a9888f7f-1aa6-4596-9690-182273d2eb3e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:14.864290 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a9888f7f-1aa6-4596-9690-182273d2eb3e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:14.864714 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a9888f7f-1aa6-4596-9690-182273d2eb3e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:14.892863 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a9888f7f-1aa6-4596-9690-182273d2eb3e tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043207 Aug 30 02:08:14.893423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 728/1426] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 30 02:08:14 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:14.953839 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-45574d05-5541-4c15-973a-93295c492597 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:14.954368 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-45574d05-5541-4c15-973a-93295c492597 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:14.962151 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45574d05-5541-4c15-973a-93295c492597 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:14.962641 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45574d05-5541-4c15-973a-93295c492597 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:14.963077 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45574d05-5541-4c15-973a-93295c492597 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:14.963768 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45574d05-5541-4c15-973a-93295c492597 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:14.964226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45574d05-5541-4c15-973a-93295c492597 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:14.964689 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-45574d05-5541-4c15-973a-93295c492597 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:14.990847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-45574d05-5541-4c15-973a-93295c492597 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Going to try to terminate instance {{(pid=120392) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:08:15.063518 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-45574d05-5541-4c15-973a-93295c492597 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "DELETE /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 204 len: 0 microversion: 2.20 time: 0.113263 Aug 30 02:08:15.064086 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 699/1427] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 02:08:14 2022] DELETE /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 02:08:15.067487 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-690e6e41-da50-4a1a-87e3-93f95b699402 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:15.069071 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-690e6e41-da50-4a1a-87e3-93f95b699402 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:15.072993 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:15.073763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:15.076055 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-690e6e41-da50-4a1a-87e3-93f95b699402 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:15.076665 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-690e6e41-da50-4a1a-87e3-93f95b699402 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:15.077229 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-690e6e41-da50-4a1a-87e3-93f95b699402 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:15.078070 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-690e6e41-da50-4a1a-87e3-93f95b699402 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:15.078592 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-690e6e41-da50-4a1a-87e3-93f95b699402 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:15.079046 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-690e6e41-da50-4a1a-87e3-93f95b699402 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:15.079688 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:15.080163 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:15.080625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:15.081334 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:15.081779 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:15.082195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:15.211748 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-690e6e41-da50-4a1a-87e3-93f95b699402 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:15.213692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:15.219562 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-690e6e41-da50-4a1a-87e3-93f95b699402 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.156165 Aug 30 02:08:15.220121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 729/1428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:15 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:08:15.221816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:15.223262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:15.224457 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-58b0d526-8fad-4173-8ef9-c551f9c17b88 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.156189 Aug 30 02:08:15.225067 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 700/1429] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:15 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:08:16.240616 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-47d4ed19-9762-4f2f-b845-8eb2659dde26 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:16.241228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-47d4ed19-9762-4f2f-b845-8eb2659dde26 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:16.247656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47d4ed19-9762-4f2f-b845-8eb2659dde26 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:16.248135 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47d4ed19-9762-4f2f-b845-8eb2659dde26 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:16.248601 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47d4ed19-9762-4f2f-b845-8eb2659dde26 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:16.248965 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:16.249378 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47d4ed19-9762-4f2f-b845-8eb2659dde26 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:16.249601 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:16.249724 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47d4ed19-9762-4f2f-b845-8eb2659dde26 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:16.250143 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-47d4ed19-9762-4f2f-b845-8eb2659dde26 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:16.256454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:16.256935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:16.257360 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:16.258037 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:16.258513 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:16.258929 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:16.386816 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:16.387621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-47d4ed19-9762-4f2f-b845-8eb2659dde26 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:16.395185 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:16.395369 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-47d4ed19-9762-4f2f-b845-8eb2659dde26 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.158517 Aug 30 02:08:16.395743 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 730/1430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:16 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:16.397341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:16.398603 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8f37c603-8946-4c0e-9685-683d6152656c tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.153525 Aug 30 02:08:16.399152 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 701/1431] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:16 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:08:17.417006 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-de3fcb1b-8416-4897-ae59-75ec889b92e1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:17.417605 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-de3fcb1b-8416-4897-ae59-75ec889b92e1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:17.421554 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:17.422166 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:17.424090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de3fcb1b-8416-4897-ae59-75ec889b92e1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:17.424602 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de3fcb1b-8416-4897-ae59-75ec889b92e1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:17.425030 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de3fcb1b-8416-4897-ae59-75ec889b92e1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:17.425718 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de3fcb1b-8416-4897-ae59-75ec889b92e1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:17.426163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de3fcb1b-8416-4897-ae59-75ec889b92e1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:17.426580 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-de3fcb1b-8416-4897-ae59-75ec889b92e1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:17.428976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:17.429467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:17.429907 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:17.430597 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:17.431051 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:17.431476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:17.558276 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-de3fcb1b-8416-4897-ae59-75ec889b92e1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:17.562105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:17.566061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-de3fcb1b-8416-4897-ae59-75ec889b92e1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.153746 Aug 30 02:08:17.566609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 731/1432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:17 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:17.570853 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:17.572319 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:17.573474 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-061a7b2a-2b13-4f6c-b762-6d14ba970349 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.155759 Aug 30 02:08:17.574020 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 702/1433] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:17 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:08:18.587790 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0b04a2b0-c012-49a8-b9e8-dcb0249ee54a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:18.588450 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0b04a2b0-c012-49a8-b9e8-dcb0249ee54a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:18.594974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0b04a2b0-c012-49a8-b9e8-dcb0249ee54a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:18.595464 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0b04a2b0-c012-49a8-b9e8-dcb0249ee54a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:18.595904 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0b04a2b0-c012-49a8-b9e8-dcb0249ee54a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:18.596317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:18.596753 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0b04a2b0-c012-49a8-b9e8-dcb0249ee54a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:18.596935 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:18.597090 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0b04a2b0-c012-49a8-b9e8-dcb0249ee54a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:18.597486 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0b04a2b0-c012-49a8-b9e8-dcb0249ee54a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:18.603481 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:18.603962 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:18.604560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:18.605257 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:18.605706 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:18.606129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:18.730388 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-0b04a2b0-c012-49a8-b9e8-dcb0249ee54a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:18.734587 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:18.738243 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0b04a2b0-c012-49a8-b9e8-dcb0249ee54a tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.155072 Aug 30 02:08:18.738977 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 732/1434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:18 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:18.743540 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:18.744997 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:18.746144 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a30cb379-6645-449b-abf6-3353808b09ca tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.153886 Aug 30 02:08:18.746676 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 703/1435] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:18 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:08:19.766649 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cea2a5f9-4d9c-440e-9ff1-cb65040e9dee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:19.767334 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cea2a5f9-4d9c-440e-9ff1-cb65040e9dee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:19.769345 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:19.769947 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:19.774213 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cea2a5f9-4d9c-440e-9ff1-cb65040e9dee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:19.774690 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cea2a5f9-4d9c-440e-9ff1-cb65040e9dee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:19.775121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cea2a5f9-4d9c-440e-9ff1-cb65040e9dee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:19.775814 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cea2a5f9-4d9c-440e-9ff1-cb65040e9dee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:19.776282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cea2a5f9-4d9c-440e-9ff1-cb65040e9dee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:19.776711 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cea2a5f9-4d9c-440e-9ff1-cb65040e9dee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:19.776863 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:19.777224 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:19.777650 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:19.778326 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:19.778769 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:19.779186 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:19.799154 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:19.919794 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:19.928532 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:19.929925 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:19.932716 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-107f9ea3-df29-4872-96ff-946a65e2a96a tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.165740 Aug 30 02:08:19.932832 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-cea2a5f9-4d9c-440e-9ff1-cb65040e9dee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:19.932969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 704/1436] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:19 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:08:19.941933 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cea2a5f9-4d9c-440e-9ff1-cb65040e9dee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1265 microversion: 2.1 time: 0.186878 Aug 30 02:08:19.942505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 733/1437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:19 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:20.954073 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:20.954685 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:20.963155 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-60016775-5cb0-4218-83a0-8fb76085406e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:20.963667 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:20.963780 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-60016775-5cb0-4218-83a0-8fb76085406e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:20.964022 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:20.964721 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:20.965423 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:20.965881 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:20.967032 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:20.969978 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60016775-5cb0-4218-83a0-8fb76085406e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:20.971529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60016775-5cb0-4218-83a0-8fb76085406e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:20.971529 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60016775-5cb0-4218-83a0-8fb76085406e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:20.971909 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60016775-5cb0-4218-83a0-8fb76085406e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:20.972205 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60016775-5cb0-4218-83a0-8fb76085406e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:20.972663 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-60016775-5cb0-4218-83a0-8fb76085406e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:21.108645 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:21.116584 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:21.118002 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:21.119146 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3791b1c7-2dc6-4835-a231-5dc2226d7b25 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.168916 Aug 30 02:08:21.119692 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 705/1438] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:20 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:21.127496 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-60016775-5cb0-4218-83a0-8fb76085406e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:21.135216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-60016775-5cb0-4218-83a0-8fb76085406e tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1453 microversion: 2.1 time: 0.176320 Aug 30 02:08:21.135768 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 734/1439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:20 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:08:21.155344 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-30e74acd-60bf-42f3-a033-edebc25ceb78 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:21.155976 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-30e74acd-60bf-42f3-a033-edebc25ceb78 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:21.161887 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30e74acd-60bf-42f3-a033-edebc25ceb78 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:21.162930 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30e74acd-60bf-42f3-a033-edebc25ceb78 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:21.163353 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30e74acd-60bf-42f3-a033-edebc25ceb78 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:21.164023 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30e74acd-60bf-42f3-a033-edebc25ceb78 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:21.164491 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30e74acd-60bf-42f3-a033-edebc25ceb78 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:21.164906 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-30e74acd-60bf-42f3-a033-edebc25ceb78 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:21.292931 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-30e74acd-60bf-42f3-a033-edebc25ceb78 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:21.300698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-30e74acd-60bf-42f3-a033-edebc25ceb78 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1453 microversion: 2.1 time: 0.148979 Aug 30 02:08:21.301244 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 706/1440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:21 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:22.142590 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:22.143297 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:22.151606 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:22.152151 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:22.152760 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:22.153685 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:22.154328 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:22.154712 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:22.303458 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:22.310329 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:22.319167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:22.320891 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:22.322356 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d41b1ef4-950c-4f86-9a79-d50c7b0e8c78 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1725 microversion: 2.20 time: 0.183723 Aug 30 02:08:22.323104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 735/1441] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:22 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:23.223697 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-0c571b31-b156-4661-b213-4d25f8eb981b req-1892d578-cf79-467c-a932-2e1e10a8e545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2b4ac0-60fb-4e49-9da3-039bcfff7698", "name": "network-vif-deleted", "tag": "b9d05127-de36-4e30-a898-feeb840846d0"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:23.239145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0c571b31-b156-4661-b213-4d25f8eb981b req-1892d578-cf79-467c-a932-2e1e10a8e545 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:23.239633 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0c571b31-b156-4661-b213-4d25f8eb981b req-1892d578-cf79-467c-a932-2e1e10a8e545 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:23.240769 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-0c571b31-b156-4661-b213-4d25f8eb981b req-1892d578-cf79-467c-a932-2e1e10a8e545 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:23.254714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-0c571b31-b156-4661-b213-4d25f8eb981b req-1892d578-cf79-467c-a932-2e1e10a8e545 service nova] Creating event network-vif-deleted:b9d05127-de36-4e30-a898-feeb840846d0 for instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 on hv-cinder-81966 Aug 30 02:08:23.262686 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-0c571b31-b156-4661-b213-4d25f8eb981b req-1892d578-cf79-467c-a932-2e1e10a8e545 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042520 Aug 30 02:08:23.263961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 707/1442] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:23.347557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:23.348149 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:23.360343 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:23.360837 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:23.374557 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:23.381476 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:23.390643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:23.393213 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:23.445813 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-e7310fc6-0fa2-4dee-aeeb-f1056eadca51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:23.447184 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-e7310fc6-0fa2-4dee-aeeb-f1056eadca51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:23.456387 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310fc6-0fa2-4dee-aeeb-f1056eadca51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:23.457135 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310fc6-0fa2-4dee-aeeb-f1056eadca51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:23.457748 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310fc6-0fa2-4dee-aeeb-f1056eadca51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:23.458635 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310fc6-0fa2-4dee-aeeb-f1056eadca51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:23.459825 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310fc6-0fa2-4dee-aeeb-f1056eadca51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:23.460629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-e7310fc6-0fa2-4dee-aeeb-f1056eadca51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:23.497073 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:23.501563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:23.501563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:23.502004 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.objects.instance [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lazy-loading 'fault' on Instance uuid df2b4ac0-60fb-4e49-9da3-039bcfff7698 {{(pid=120391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:08:23.596910 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:23.606979 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:23.610131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85d2f3d2a8cb40d38d0ca2dc16609ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0db8e5fc6c48cc98136ef2a85b05f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:23.612559 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-354cfefe-e0be-4678-9fec-2a845923c336 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 200 len: 1371 microversion: 2.20 time: 0.267992 Aug 30 02:08:23.613808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 736/1443] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:23 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:23.636766 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-e7310fc6-0fa2-4dee-aeeb-f1056eadca51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lazy-loading 'services' on Instance uuid 3b50d3ec-1225-4320-8c41-e394ffb2c672 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:08:23.765148 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-e7310fc6-0fa2-4dee-aeeb-f1056eadca51 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-volume_attachments/996ea2ac-4da0-49e2-87c9-45b05bbfaeac" status: 202 len: 0 microversion: 2.1 time: 0.323621 Aug 30 02:08:23.767027 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 708/1444] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 30 02:08:23 2022] DELETE /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-volume_attachments/996ea2ac-4da0-49e2-87c9-45b05bbfaeac => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:08:23.775653 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6d2576e7-f836-4f03-a3df-0e14ea30a163 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:23.778643 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-6d2576e7-f836-4f03-a3df-0e14ea30a163 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:23.806094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2576e7-f836-4f03-a3df-0e14ea30a163 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:23.806591 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2576e7-f836-4f03-a3df-0e14ea30a163 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:23.807031 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2576e7-f836-4f03-a3df-0e14ea30a163 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:23.808256 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2576e7-f836-4f03-a3df-0e14ea30a163 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:23.808911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2576e7-f836-4f03-a3df-0e14ea30a163 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:23.810274 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-6d2576e7-f836-4f03-a3df-0e14ea30a163 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:23.860220 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6d2576e7-f836-4f03-a3df-0e14ea30a163 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089396 Aug 30 02:08:23.865578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 737/1445] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:08:23 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:24.083646 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-1230f266-c413-4164-a8db-1e4911ac25be req-1100726e-696b-4195-bc9d-b63a0f0cf30a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abbdd816-5a15-4bae-8a89-db3311a05834", "tag": "fa395eb0-fc02-438c-bfe1-12e3122b63fb"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:24.101084 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-1230f266-c413-4164-a8db-1e4911ac25be req-1100726e-696b-4195-bc9d-b63a0f0cf30a service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:24.103367 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-1230f266-c413-4164-a8db-1e4911ac25be req-1100726e-696b-4195-bc9d-b63a0f0cf30a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:24.103812 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-1230f266-c413-4164-a8db-1e4911ac25be req-1100726e-696b-4195-bc9d-b63a0f0cf30a service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:24.126446 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-1230f266-c413-4164-a8db-1e4911ac25be req-1100726e-696b-4195-bc9d-b63a0f0cf30a service nova] Creating event network-changed:fa395eb0-fc02-438c-bfe1-12e3122b63fb for instance abbdd816-5a15-4bae-8a89-db3311a05834 on hv-cinder-81966 Aug 30 02:08:24.133376 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-1230f266-c413-4164-a8db-1e4911ac25be req-1100726e-696b-4195-bc9d-b63a0f0cf30a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.360246 Aug 30 02:08:24.139877 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 709/1446] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:24.640505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:24.641692 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:24.659453 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:24.660258 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:24.660877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:24.661768 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:24.662514 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:24.663104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:24.691629 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] HTTP exception thrown: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Request method failure captured: Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 HTTP/1.1 Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4X64o39ZUiMuiHXUwPYD3C2Dul1nRGf51BW61E6BVedhHbJYm92v4XSQOsozco1v3ndr0kIxrKZhWCD-pCs8InLN3x2f3n9irXsxea_jImynDz66kDrrijn5rt6fJWcvfhKxCxpVodFHVJH4t3a5VlOkmh_jLOvSfsKpTvWxvU7A0 Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:24.694123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b0db8e5fc6c48cc98136ef2a85b05f4"}]}] Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 85d2f3d2a8cb40d38d0ca2dc16609ef5 Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:24.696060 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': 'df2b4ac0-60fb-4e49-9da3-039bcfff7698'} Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:24.697072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:24.698738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:24.701067 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Returning 404 to user: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:24.702179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-0a628bda-45c6-4550-ad07-752785e785b4 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 404 len: 111 microversion: 2.20 time: 0.070351 Aug 30 02:08:24.706993 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 738/1447] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:24 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:08:24.713475 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-416cbdc4-e708-46ad-9e93-f69c3c36a0d9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '.version_select at 0x7f3b084361f0>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:24.771076 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-416cbdc4-e708-46ad-9e93-f69c3c36a0d9 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466193224" status: 204 len: 0 microversion: 2.20 time: 0.062996 Aug 30 02:08:24.772580 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 710/1448] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 30 02:08:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466193224 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 02:08:24.873325 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-09c651b5-9aea-4df7-b2db-292e39174be9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:24.875480 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-09c651b5-9aea-4df7-b2db-292e39174be9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:24.882615 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-09c651b5-9aea-4df7-b2db-292e39174be9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:24.883830 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-09c651b5-9aea-4df7-b2db-292e39174be9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:24.887016 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-09c651b5-9aea-4df7-b2db-292e39174be9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:24.888111 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-09c651b5-9aea-4df7-b2db-292e39174be9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:24.888607 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-09c651b5-9aea-4df7-b2db-292e39174be9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:24.889038 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-09c651b5-9aea-4df7-b2db-292e39174be9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:24.943091 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-09c651b5-9aea-4df7-b2db-292e39174be9 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074338 Aug 30 02:08:24.957680 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 739/1449] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:08:24 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:25.955974 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9fa4dfcb-52d6-48d5-b150-5fb83f70516d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:25.958494 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-9fa4dfcb-52d6-48d5-b150-5fb83f70516d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:25.966134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9fa4dfcb-52d6-48d5-b150-5fb83f70516d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:25.966620 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9fa4dfcb-52d6-48d5-b150-5fb83f70516d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:25.967092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9fa4dfcb-52d6-48d5-b150-5fb83f70516d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:25.968135 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9fa4dfcb-52d6-48d5-b150-5fb83f70516d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:25.968675 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9fa4dfcb-52d6-48d5-b150-5fb83f70516d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:25.969167 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-9fa4dfcb-52d6-48d5-b150-5fb83f70516d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.000552 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9fa4dfcb-52d6-48d5-b150-5fb83f70516d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049116 Aug 30 02:08:26.001176 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 711/1450] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 30 02:08:25 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:08:26.067167 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c183c302-334b-4be5-af29-6a03146ce7fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:26.067658 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c183c302-334b-4be5-af29-6a03146ce7fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:26.074750 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c183c302-334b-4be5-af29-6a03146ce7fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.075240 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c183c302-334b-4be5-af29-6a03146ce7fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.075680 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c183c302-334b-4be5-af29-6a03146ce7fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.076412 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c183c302-334b-4be5-af29-6a03146ce7fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.076866 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c183c302-334b-4be5-af29-6a03146ce7fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.077287 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c183c302-334b-4be5-af29-6a03146ce7fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.102843 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c183c302-334b-4be5-af29-6a03146ce7fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Going to try to terminate instance {{(pid=120391) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:08:26.180288 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c183c302-334b-4be5-af29-6a03146ce7fc tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 204 len: 0 microversion: 2.1 time: 0.116331 Aug 30 02:08:26.181953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 740/1451] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:26 2022] DELETE /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:08:26.189960 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-899e981a-194a-446d-91cd-dfa7019a82ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:26.190578 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-899e981a-194a-446d-91cd-dfa7019a82ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:26.197569 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-899e981a-194a-446d-91cd-dfa7019a82ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.198275 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-899e981a-194a-446d-91cd-dfa7019a82ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.198714 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-899e981a-194a-446d-91cd-dfa7019a82ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.199412 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-899e981a-194a-446d-91cd-dfa7019a82ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.199864 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-899e981a-194a-446d-91cd-dfa7019a82ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.200373 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-899e981a-194a-446d-91cd-dfa7019a82ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.339077 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-899e981a-194a-446d-91cd-dfa7019a82ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:26.347078 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-899e981a-194a-446d-91cd-dfa7019a82ab tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1680 microversion: 2.1 time: 0.160962 Aug 30 02:08:26.347724 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 712/1452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:26 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:26.736079 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:26.736850 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:26.738758 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:26.744749 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.745313 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.745926 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.746621 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.747072 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.747505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.764409 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] HTTP exception thrown: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Request method failure captured: Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: DELETE /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 HTTP/1.1 Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4X64o39ZUiMuiHXUwPYD3C2Dul1nRGf51BW61E6BVedhHbJYm92v4XSQOsozco1v3ndr0kIxrKZhWCD-pCs8InLN3x2f3n9irXsxea_jImynDz66kDrrijn5rt6fJWcvfhKxCxpVodFHVJH4t3a5VlOkmh_jLOvSfsKpTvWxvU7A0 Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:26.766148 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b0db8e5fc6c48cc98136ef2a85b05f4"}]}] Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 85d2f3d2a8cb40d38d0ca2dc16609ef5 Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:26.767913 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': 'df2b4ac0-60fb-4e49-9da3-039bcfff7698'} Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:26.768742 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:26.770756 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:26.773134 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Returning 404 to user: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:26.773134 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-249f05b0-ec87-49ad-b895-8fefc20656c6 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "DELETE /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 404 len: 111 microversion: 2.20 time: 0.036752 Aug 30 02:08:26.773134 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 741/1453] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 02:08:26 2022] DELETE /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:08:26.777117 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:26.777722 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: df2b4ac0-60fb-4e49-9da3-039bcfff7698] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:26.779668 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:26.784533 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.785021 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.785484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.786134 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.786587 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.787005 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.802924 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] HTTP exception thrown: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Request method failure captured: Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 HTTP/1.1 Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4X64o39ZUiMuiHXUwPYD3C2Dul1nRGf51BW61E6BVedhHbJYm92v4XSQOsozco1v3ndr0kIxrKZhWCD-pCs8InLN3x2f3n9irXsxea_jImynDz66kDrrijn5rt6fJWcvfhKxCxpVodFHVJH4t3a5VlOkmh_jLOvSfsKpTvWxvU7A0 Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:08:26.804553 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b0db8e5fc6c48cc98136ef2a85b05f4"}]}] Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 85d2f3d2a8cb40d38d0ca2dc16609ef5 Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:26.806362 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': 'df2b4ac0-60fb-4e49-9da3-039bcfff7698'} Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:26.809221 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. Aug 30 02:08:26.810879 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:26.812430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Returning 404 to user: Instance df2b4ac0-60fb-4e49-9da3-039bcfff7698 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:26.812430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-75e55950-255c-48fa-aef9-cabc8d27e277 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698" status: 404 len: 111 microversion: 2.20 time: 0.032652 Aug 30 02:08:26.812430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 713/1454] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:26 2022] GET /compute/v2.1/servers/df2b4ac0-60fb-4e49-9da3-039bcfff7698 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 02:08:27.368460 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e7650f15-7459-4601-be39-d789945c63cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:27.369096 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e7650f15-7459-4601-be39-d789945c63cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:27.375385 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e7650f15-7459-4601-be39-d789945c63cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:27.375865 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e7650f15-7459-4601-be39-d789945c63cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:27.376505 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e7650f15-7459-4601-be39-d789945c63cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:27.377198 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e7650f15-7459-4601-be39-d789945c63cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:27.377656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e7650f15-7459-4601-be39-d789945c63cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:27.378081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e7650f15-7459-4601-be39-d789945c63cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:27.523123 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-e7650f15-7459-4601-be39-d789945c63cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:27.531574 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e7650f15-7459-4601-be39-d789945c63cf tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1680 microversion: 2.1 time: 0.167344 Aug 30 02:08:27.532413 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 742/1455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:27 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:27.946119 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:27.946770 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:27.953332 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:27.953813 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:27.954248 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:27.954950 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:27.955386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:27.955803 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:27.970476 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] HTTP exception thrown: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Request method failure captured: Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 HTTP/1.1 Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4X64o39ZUiMuiHXUwPYD3C2Dul1nRGf51BW61E6BVedhHbJYm92v4XSQOsozco1v3ndr0kIxrKZhWCD-pCs8InLN3x2f3n9irXsxea_jImynDz66kDrrijn5rt6fJWcvfhKxCxpVodFHVJH4t3a5VlOkmh_jLOvSfsKpTvWxvU7A0 Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:08:27.972210 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b0db8e5fc6c48cc98136ef2a85b05f4"}]}] Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 85d2f3d2a8cb40d38d0ca2dc16609ef5 Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:08:27.973969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '51036535-5cf5-4283-b501-b0809e3f57a6'} Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:27.975517 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:08:27.977129 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:27.978744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Returning 404 to user: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:27.978744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6109a2c7-b507-4255-b254-4385e88eec7d tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "DELETE /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 404 len: 111 microversion: 2.20 time: 0.031361 Aug 30 02:08:27.978744 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 714/1456] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 30 02:08:27 2022] DELETE /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:08:27.987298 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:27.987912 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] [instance: 51036535-5cf5-4283-b501-b0809e3f57a6] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:27.994199 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:27.994686 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:27.995127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:27.995827 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:27.996299 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:27.996929 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:28.010622 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] HTTP exception thrown: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Request method failure captured: Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 HTTP/1.1 Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4X64o39ZUiMuiHXUwPYD3C2Dul1nRGf51BW61E6BVedhHbJYm92v4XSQOsozco1v3ndr0kIxrKZhWCD-pCs8InLN3x2f3n9irXsxea_jImynDz66kDrrijn5rt6fJWcvfhKxCxpVodFHVJH4t3a5VlOkmh_jLOvSfsKpTvWxvU7A0 Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:28.012609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b0db8e5fc6c48cc98136ef2a85b05f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b0db8e5fc6c48cc98136ef2a85b05f4"}]}] Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 4b0db8e5fc6c48cc98136ef2a85b05f4 Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110641049 Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 85d2f3d2a8cb40d38d0ca2dc16609ef5 Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110641049-project Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:08:28.014380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '51036535-5cf5-4283-b501-b0809e3f57a6'} Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:28.015327 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. Aug 30 02:08:28.017034 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:28.018550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] Returning 404 to user: Instance 51036535-5cf5-4283-b501-b0809e3f57a6 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:28.018550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-503759b6-6806-4e0a-aa5e-4fd1f8310de8 tempest-AttachVolumeShelveTestJSON-2110641049 tempest-AttachVolumeShelveTestJSON-2110641049-project] 10.222.0.50 "GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6" status: 404 len: 111 microversion: 2.20 time: 0.030608 Aug 30 02:08:28.018550 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 743/1457] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:27 2022] GET /compute/v2.1/servers/51036535-5cf5-4283-b501-b0809e3f57a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:08:28.553448 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8285695d-f94f-4fcb-9f59-846adb9569db tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:28.554538 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-8285695d-f94f-4fcb-9f59-846adb9569db tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:28.564283 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8285695d-f94f-4fcb-9f59-846adb9569db tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:28.566103 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8285695d-f94f-4fcb-9f59-846adb9569db tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:28.566747 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8285695d-f94f-4fcb-9f59-846adb9569db tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:28.567559 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8285695d-f94f-4fcb-9f59-846adb9569db tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:28.568738 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8285695d-f94f-4fcb-9f59-846adb9569db tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:28.569842 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-8285695d-f94f-4fcb-9f59-846adb9569db tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:28.841647 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-8285695d-f94f-4fcb-9f59-846adb9569db tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:28.849786 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8285695d-f94f-4fcb-9f59-846adb9569db tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1680 microversion: 2.1 time: 0.300371 Aug 30 02:08:28.850342 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 715/1458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:28 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1680 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:29.481303 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [req-b2268cdb-c4cf-473e-9bcd-3057e8467223 req-90a625d3-bb7b-4b28-80e0-96e35c27c261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b50d3ec-1225-4320-8c41-e394ffb2c672", "name": "network-vif-deleted", "tag": "3732c5ab-0493-47ef-aa5f-28b96b148a74"}]} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:29.504340 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b2268cdb-c4cf-473e-9bcd-3057e8467223 req-90a625d3-bb7b-4b28-80e0-96e35c27c261 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:29.504832 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b2268cdb-c4cf-473e-9bcd-3057e8467223 req-90a625d3-bb7b-4b28-80e0-96e35c27c261 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:29.505265 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [req-b2268cdb-c4cf-473e-9bcd-3057e8467223 req-90a625d3-bb7b-4b28-80e0-96e35c27c261 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:29.534216 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.compute.server_external_events [req-b2268cdb-c4cf-473e-9bcd-3057e8467223 req-90a625d3-bb7b-4b28-80e0-96e35c27c261 service nova] Creating event network-vif-deleted:3732c5ab-0493-47ef-aa5f-28b96b148a74 for instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 on hv-cinder-81966 Aug 30 02:08:29.544615 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [req-b2268cdb-c4cf-473e-9bcd-3057e8467223 req-90a625d3-bb7b-4b28-80e0-96e35c27c261 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067003 Aug 30 02:08:29.547012 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 744/1459] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:29.872414 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:29.872952 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:29.884327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:29.885488 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:29.886738 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:29.888629 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:29.889734 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:29.890055 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:29.963174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:29.963648 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:29.964107 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:29.964695 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.objects.instance [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lazy-loading 'fault' on Instance uuid 3b50d3ec-1225-4320-8c41-e394ffb2c672 {{(pid=120392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:08:30.294705 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06de37941264b979a3bd5aaf84ec73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d96d936ce8417197008a59da394df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:30.308885 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-6966ccf5-0813-46f3-81c0-897a8495fe3c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 200 len: 1331 microversion: 2.1 time: 0.441190 Aug 30 02:08:30.312757 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 716/1460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:29 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 1331 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:31.336378 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:31.337799 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:31.346233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:31.346825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:31.347483 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:31.348299 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:31.348717 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:31.349144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:31.364707 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 HTTP/1.1 Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:31.366785 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:31.368608 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '3b50d3ec-1225-4320-8c41-e394ffb2c672'} Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:31.369584 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:31.371563 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:31.373005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:31.373005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e3434134-4124-44bc-a570-083df641028d tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 404 len: 111 microversion: 2.1 time: 0.038672 Aug 30 02:08:31.373005 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 745/1461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:31 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:31.379840 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-8fd94328-bba2-4e04-bef2-48511d9c1725 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '.version_select at 0x7f3b0b7ecd30>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:31.404743 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-8fd94328-bba2-4e04-bef2-48511d9c1725 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101461739" status: 202 len: 0 microversion: 2.1 time: 0.029278 Aug 30 02:08:31.408277 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 717/1462] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 30 02:08:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101461739 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:08:33.398463 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:33.400094 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:33.407227 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:33.408217 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:33.408770 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:33.410696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:33.411528 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:33.412380 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:33.442346 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: DELETE /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 HTTP/1.1 Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:33.444862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:33.446374 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '3b50d3ec-1225-4320-8c41-e394ffb2c672'} Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:33.447233 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:33.448715 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.450307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:33.450307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-cbde3f92-6d43-43a1-a733-cc13df6a1712 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 404 len: 111 microversion: 2.1 time: 0.055723 Aug 30 02:08:33.450707 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 746/1463] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:33 2022] DELETE /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:33.462707 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:33.463447 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 3b50d3ec-1225-4320-8c41-e394ffb2c672] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:33.472266 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:33.472784 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:33.473219 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:33.473952 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:33.474951 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:33.475409 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:33.493676 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 HTTP/1.1 Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:33.497080 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:33.498817 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '3b50d3ec-1225-4320-8c41-e394ffb2c672'} Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:33.499696 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. Aug 30 02:08:33.501336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.502698 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 3b50d3ec-1225-4320-8c41-e394ffb2c672 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:33.503164 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-459792d4-82f9-4965-a91f-cb9740db0901 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672" status: 404 len: 111 microversion: 2.1 time: 0.044014 Aug 30 02:08:33.504459 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 747/1464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:33 2022] GET /compute/v2.1/servers/3b50d3ec-1225-4320-8c41-e394ffb2c672 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:33.579294 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-62c63493-29ae-4973-b038-30b0e65d1a5f tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Action: 'create', calling method: .version_select at 0x7f3b081d3c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1772654068", "metadata": {"Type": "work"}}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-62c63493-29ae-4973-b038-30b0e65d1a5f tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Request method failure captured: Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 122 Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDXEhvsgLIkrOHZV_oKVUi3s622WGHEBuxaGaGd9K80VsY7MG-yZunW1ggTKN_q6caTlpEfFX3xcrcdCippIQeKNcF9iO0XqWhzYRqBP4BcfheN1aPwpx1T2SbjMajAPz0kjl5WP1-y8-S4Xqz0CiDnSzyhToB36HCJLxPl5fzcYVYpM Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:08:33.602612 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ba46e33140ea42d9bda6144dbda37f07"}]}] Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 86aa47eb9a3a42908173e0031d46d695 Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1772654068", "metadata": {"Type": "work"}}} Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: Aug 30 02:08:33.604512 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1772654068', 'metadata': {'Type': 'work'}}}} Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise error Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:33.605624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 02:08:33.607439 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 02:08:33.609001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 02:08:33.609001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.609001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-62c63493-29ae-4973-b038-30b0e65d1a5f tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:33.609001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-62c63493-29ae-4973-b038-30b0e65d1a5f tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.181329 Aug 30 02:08:33.609001 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 718/1465] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 30 02:08:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 02:08:33.618221 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fb48c822-826b-42d9-bbc7-028134569bb8 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Action: 'create', calling method: .version_select at 0x7f3b08336670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-847640354", "metadata": {"Type": "work"}}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fb48c822-826b-42d9-bbc7-028134569bb8 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Request method failure captured: Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 119 Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDXEhvsgLIkrOHZV_oKVUi3s622WGHEBuxaGaGd9K80VsY7MG-yZunW1ggTKN_q6caTlpEfFX3xcrcdCippIQeKNcF9iO0XqWhzYRqBP4BcfheN1aPwpx1T2SbjMajAPz0kjl5WP1-y8-S4Xqz0CiDnSzyhToB36HCJLxPl5fzcYVYpM Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:33.623163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ba46e33140ea42d9bda6144dbda37f07"}]}] Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 86aa47eb9a3a42908173e0031d46d695 Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-847640354", "metadata": {"Type": "work"}}} Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: Aug 30 02:08:33.624716 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-847640354', 'metadata': {'Type': 'work'}}}} Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise error Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi '0' Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:33.625604 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 02:08:33.627474 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 02:08:33.629600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 02:08:33.629600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.629600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fb48c822-826b-42d9-bbc7-028134569bb8 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:33.629600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-fb48c822-826b-42d9-bbc7-028134569bb8 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011194 Aug 30 02:08:33.629600 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 748/1466] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 30 02:08:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:08:33.636350 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5ecfcfe6-b18e-45f2-a48a-76af4560a51c tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Action: 'create', calling method: .version_select at 0x7f3b0b800280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-953664744", "metadata": {"Type": "work"}}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5ecfcfe6-b18e-45f2-a48a-76af4560a51c tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Request method failure captured: Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 118 Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDXEhvsgLIkrOHZV_oKVUi3s622WGHEBuxaGaGd9K80VsY7MG-yZunW1ggTKN_q6caTlpEfFX3xcrcdCippIQeKNcF9iO0XqWhzYRqBP4BcfheN1aPwpx1T2SbjMajAPz0kjl5WP1-y8-S4Xqz0CiDnSzyhToB36HCJLxPl5fzcYVYpM Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:08:33.639851 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ba46e33140ea42d9bda6144dbda37f07"}]}] Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 86aa47eb9a3a42908173e0031d46d695 Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-953664744", "metadata": {"Type": "work"}}} Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: Aug 30 02:08:33.641295 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-953664744', 'metadata': {'Type': 'work'}}}} Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise error Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi '' Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:33.646085 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 02:08:33.647562 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 02:08:33.648848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 02:08:33.648848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.648848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-5ecfcfe6-b18e-45f2-a48a-76af4560a51c tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:33.648848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-5ecfcfe6-b18e-45f2-a48a-76af4560a51c tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010991 Aug 30 02:08:33.648848 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 719/1467] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 30 02:08:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 02:08:33.651262 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6cd844e3-baf2-4122-b44c-07bfbd64ccbf tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Calling method '.version_select at 0x7f3b03f265e0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:33.681310 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-6cd844e3-baf2-4122-b44c-07bfbd64ccbf tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] HTTP exception thrown: Volume tempest-invalid-748979398 could not be found. Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6cd844e3-baf2-4122-b44c-07bfbd64ccbf tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Request method failure captured: Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-748979398 HTTP/1.1 Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDXEhvsgLIkrOHZV_oKVUi3s622WGHEBuxaGaGd9K80VsY7MG-yZunW1ggTKN_q6caTlpEfFX3xcrcdCippIQeKNcF9iO0XqWhzYRqBP4BcfheN1aPwpx1T2SbjMajAPz0kjl5WP1-y8-S4Xqz0CiDnSzyhToB36HCJLxPl5fzcYVYpM Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:33.683351 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ba46e33140ea42d9bda6144dbda37f07"}]}] Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 86aa47eb9a3a42908173e0031d46d695 Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Volume tempest-invalid-748979398 could not be found. Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': 'tempest-invalid-748979398'} Aug 30 02:08:33.684853 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-748979398 could not be found. (HTTP 404) (Request-ID: req-113a667b-7e87-41e2-876c-b24f03883324) Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.685798 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 02:08:33.688279 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-748979398 could not be found. Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:33.690670 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-748979398 could not be found. Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-748979398 could not be found. Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6cd844e3-baf2-4122-b44c-07bfbd64ccbf tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Returning 404 to user: Volume tempest-invalid-748979398 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6cd844e3-baf2-4122-b44c-07bfbd64ccbf tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-748979398" status: 404 len: 98 microversion: 2.1 time: 0.037601 Aug 30 02:08:33.692277 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 749/1468] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Aug 30 02:08:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-748979398 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 02:08:33.694233 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-2902de39-9c06-471f-82c1-98b752942e66 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003727 Aug 30 02:08:33.694717 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 720/1469] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 30 02:08:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 30 02:08:33.703784 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-7bf911c9-335b-4fb8-9e2a-be76b4c1e3a2 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004357 Aug 30 02:08:33.704336 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 750/1470] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 30 02:08:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 02:08:33.712932 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1df98b47-4ef1-47a3-9d5d-5ad3000122a5 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Calling method '.version_select at 0x7f3b0804c430>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:33.742503 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-1df98b47-4ef1-47a3-9d5d-5ad3000122a5 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] HTTP exception thrown: Volume 73811a2e-7e99-421c-95d6-99be8931d354 could not be found. Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1df98b47-4ef1-47a3-9d5d-5ad3000122a5 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Request method failure captured: Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/os-volumes/73811a2e-7e99-421c-95d6-99be8931d354 HTTP/1.1 Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDXEhvsgLIkrOHZV_oKVUi3s622WGHEBuxaGaGd9K80VsY7MG-yZunW1ggTKN_q6caTlpEfFX3xcrcdCippIQeKNcF9iO0XqWhzYRqBP4BcfheN1aPwpx1T2SbjMajAPz0kjl5WP1-y8-S4Xqz0CiDnSzyhToB36HCJLxPl5fzcYVYpM Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:08:33.749637 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ba46e33140ea42d9bda6144dbda37f07"}]}] Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: 86aa47eb9a3a42908173e0031d46d695 Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Volume 73811a2e-7e99-421c-95d6-99be8931d354 could not be found. Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '73811a2e-7e99-421c-95d6-99be8931d354'} Aug 30 02:08:33.751160 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73811a2e-7e99-421c-95d6-99be8931d354 could not be found. (HTTP 404) (Request-ID: req-8931e0ef-6051-4eb9-9ff4-baa0da806176) Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.752410 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 02:08:33.753719 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73811a2e-7e99-421c-95d6-99be8931d354 could not be found. Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 02:08:33.754967 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73811a2e-7e99-421c-95d6-99be8931d354 could not be found. Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73811a2e-7e99-421c-95d6-99be8931d354 could not be found. Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-1df98b47-4ef1-47a3-9d5d-5ad3000122a5 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Returning 404 to user: Volume 73811a2e-7e99-421c-95d6-99be8931d354 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-1df98b47-4ef1-47a3-9d5d-5ad3000122a5 tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/73811a2e-7e99-421c-95d6-99be8931d354" status: 404 len: 109 microversion: 2.1 time: 0.041851 Aug 30 02:08:33.756763 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 721/1471] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 02:08:33 2022] DELETE /compute/v2.1/os-volumes/73811a2e-7e99-421c-95d6-99be8931d354 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:08:33.763065 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-96793824-9f0b-4b7f-aedd-c8d13cacc66f tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Calling method '.version_select at 0x7f3b0b882ee0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:33.792974 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-96793824-9f0b-4b7f-aedd-c8d13cacc66f tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] HTTP exception thrown: Volume 1e4f020e-e19b-4440-b354-a8b57fd70c69 could not be found. Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-96793824-9f0b-4b7f-aedd-c8d13cacc66f tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Request method failure captured: Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/os-volumes/1e4f020e-e19b-4440-b354-a8b57fd70c69 HTTP/1.1 Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDXEhvsgLIkrOHZV_oKVUi3s622WGHEBuxaGaGd9K80VsY7MG-yZunW1ggTKN_q6caTlpEfFX3xcrcdCippIQeKNcF9iO0XqWhzYRqBP4BcfheN1aPwpx1T2SbjMajAPz0kjl5WP1-y8-S4Xqz0CiDnSzyhToB36HCJLxPl5fzcYVYpM Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:33.795104 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ba46e33140ea42d9bda6144dbda37f07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ba46e33140ea42d9bda6144dbda37f07"}]}] Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: ba46e33140ea42d9bda6144dbda37f07 Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-VolumesNegativeTest-837256146 Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: 86aa47eb9a3a42908173e0031d46d695 Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-VolumesNegativeTest-837256146-project Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Volume 1e4f020e-e19b-4440-b354-a8b57fd70c69 could not be found. Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '1e4f020e-e19b-4440-b354-a8b57fd70c69'} Aug 30 02:08:33.796794 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e4f020e-e19b-4440-b354-a8b57fd70c69 could not be found. (HTTP 404) (Request-ID: req-209705b5-958d-4211-a984-9b428189b50d) Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.797728 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:08:33.799081 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e4f020e-e19b-4440-b354-a8b57fd70c69 could not be found. Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 02:08:33.801086 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e4f020e-e19b-4440-b354-a8b57fd70c69 could not be found. Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e4f020e-e19b-4440-b354-a8b57fd70c69 could not be found. Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-96793824-9f0b-4b7f-aedd-c8d13cacc66f tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] Returning 404 to user: Volume 1e4f020e-e19b-4440-b354-a8b57fd70c69 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-96793824-9f0b-4b7f-aedd-c8d13cacc66f tempest-VolumesNegativeTest-837256146 tempest-VolumesNegativeTest-837256146-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/1e4f020e-e19b-4440-b354-a8b57fd70c69" status: 404 len: 109 microversion: 2.1 time: 0.037966 Aug 30 02:08:33.803871 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 751/1472] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:33 2022] GET /compute/v2.1/os-volumes/1e4f020e-e19b-4440-b354-a8b57fd70c69 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:34.678084 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:34.678651 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:34.686199 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:34.686681 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:34.687112 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:34.687802 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:34.688267 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:34.688702 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:34.701781 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 HTTP/1.1 Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:08:34.703317 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:08:34.705145 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '134294ec-5f9d-4bb0-9072-1a5d77761ad0'} Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:34.705995 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:08:34.707341 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.709269 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:34.709269 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-97fc5cc8-b1ab-4d3c-ba5d-56f2c77cfbb1 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 404 len: 111 microversion: 2.1 time: 0.031203 Aug 30 02:08:34.709269 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 722/1473] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:34 2022] DELETE /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:34.717308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:34.717308 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 134294ec-5f9d-4bb0-9072-1a5d77761ad0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:34.725282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:34.725984 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:34.726482 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:34.727241 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:34.727788 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:34.728368 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:34.742144 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 HTTP/1.1 Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:34.743656 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:08:34.745212 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '134294ec-5f9d-4bb0-9072-1a5d77761ad0'} Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:34.746127 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. Aug 30 02:08:34.747470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.748866 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 134294ec-5f9d-4bb0-9072-1a5d77761ad0 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:34.748866 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-8a836b6a-ef9d-4b1f-95f9-fbabc4d445b4 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0" status: 404 len: 111 microversion: 2.1 time: 0.035274 Aug 30 02:08:34.748866 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 752/1474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:34 2022] GET /compute/v2.1/servers/134294ec-5f9d-4bb0-9072-1a5d77761ad0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:34.754385 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:34.754892 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:34.761896 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:34.762388 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:34.762936 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:34.763677 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:34.764130 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:34.764627 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:34.779785 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 HTTP/1.1 Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:08:34.781403 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:08:34.783195 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '93f56e8b-8c6b-469a-a47d-40fb70a05cb0'} Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:34.784226 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:08:34.785969 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.788625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:34.788625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a1d87f4d-5715-4113-9d8a-65923c6b9d9c tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 404 len: 111 microversion: 2.1 time: 0.032345 Aug 30 02:08:34.788625 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 723/1475] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:34 2022] DELETE /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:34.791680 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:34.792305 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 93f56e8b-8c6b-469a-a47d-40fb70a05cb0] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:34.798738 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:34.799232 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:34.799671 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:34.800414 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:34.800869 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:34.801300 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:34.814825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 HTTP/1.1 Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:34.816395 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:08:34.817894 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '93f56e8b-8c6b-469a-a47d-40fb70a05cb0'} Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:34.818889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. Aug 30 02:08:34.820577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:34.822252 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 93f56e8b-8c6b-469a-a47d-40fb70a05cb0 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:34.822252 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e850e030-c718-4963-bc3d-3aefb2cd277e tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0" status: 404 len: 111 microversion: 2.1 time: 0.029866 Aug 30 02:08:34.822252 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 753/1476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:34 2022] GET /compute/v2.1/servers/93f56e8b-8c6b-469a-a47d-40fb70a05cb0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:08:35.960914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:35.961696 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:35.969895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:35.970500 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:35.971174 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:35.973066 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:35.973617 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:35.974745 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:35.989473 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec HTTP/1.1 Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:08:35.992664 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:08:35.994576 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '22f76949-51c7-4027-bca6-70e517d28eec'} Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:35.995466 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:08:35.997624 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:35.999262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:35.999262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-a8d12826-ec64-4e05-9407-60be84c68475 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "DELETE /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 404 len: 111 microversion: 2.1 time: 0.037142 Aug 30 02:08:35.999262 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 724/1477] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:35 2022] DELETE /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:36.001415 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:36.002049 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] [instance: 22f76949-51c7-4027-bca6-70e517d28eec] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:36.008085 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:36.008585 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:36.009278 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:36.009975 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:36.010431 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:36.010877 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:36.028862 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] HTTP exception thrown: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Request method failure captured: Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec HTTP/1.1 Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW4RUqM2-s63CZiw71usvZRjAFju_TBJfdWgYI6aYJmxeAkBtFRegG8M1jkyPFFryIeubbL9Nt6vWZpH_Lw3K5b56Bift3wYooDFRMAlpMFsTY7fjK6aGQefYYV-Zam41EMTVpjoEfeHyZH4RnQxPE2tYCSxlxwuA1otxsiw_7h-XKE Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:08:36.031061 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b9d96d936ce8417197008a59da394df7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b9d96d936ce8417197008a59da394df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b9d96d936ce8417197008a59da394df7"}]}] Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: b9d96d936ce8417197008a59da394df7 Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1217308097 Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: a06de37941264b979a3bd5aaf84ec73c Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-AttachVolumeNegativeTest-1217308097-project Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:08:36.032808 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '22f76949-51c7-4027-bca6-70e517d28eec'} Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:36.033627 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. Aug 30 02:08:36.034947 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:08:36.036136 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] Returning 404 to user: Instance 22f76949-51c7-4027-bca6-70e517d28eec could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:36.036136 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f6747181-19a0-4e5b-8112-20200051e7c2 tempest-AttachVolumeNegativeTest-1217308097 tempest-AttachVolumeNegativeTest-1217308097-project] 10.222.0.50 "GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec" status: 404 len: 111 microversion: 2.1 time: 0.034878 Aug 30 02:08:36.036136 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 754/1478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:35 2022] GET /compute/v2.1/servers/22f76949-51c7-4027-bca6-70e517d28eec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:08:41.213998 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-b69c067c-9174-4460-a749-3635112974bb tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] Action: 'create', calling method: .version_select at 0x7f3b0b7a2dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1082596826", "metadata": {"Type": "work"}}} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:41.603619 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-b69c067c-9174-4460-a749-3635112974bb tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.532034 Aug 30 02:08:41.604833 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 725/1479] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 30 02:08:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 534 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 02:08:41.619836 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-1ca303e5-2304-42b6-9e19-97064c99265e tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] Calling method '.version_select at 0x7f3b0b831a60>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:41.696919 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-1ca303e5-2304-42b6-9e19-97064c99265e tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db" status: 200 len: 353 microversion: 2.1 time: 0.083698 Aug 30 02:08:41.697475 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 755/1480] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:41 2022] GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:42.711690 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-ac958b19-45b8-4f9e-ab71-498b7ba2f088 tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] Calling method '.version_select at 0x7f3b0b76d700>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:42.770267 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-ac958b19-45b8-4f9e-ab71-498b7ba2f088 tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db" status: 200 len: 354 microversion: 2.1 time: 0.063584 Aug 30 02:08:42.770841 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 726/1481] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:42 2022] GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:42.783578 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-63fce49a-2a41-4cc0-8579-e92c00bc8b11 tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] Calling method '.version_select at 0x7f3b03ff9dc0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:42.846619 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-63fce49a-2a41-4cc0-8579-e92c00bc8b11 tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db" status: 200 len: 354 microversion: 2.1 time: 0.066969 Aug 30 02:08:42.852506 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 756/1482] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:42 2022] GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:42.866265 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-f951382d-e17a-4323-b1aa-aef7e9da40cf tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] Calling method '.version_select at 0x7f3b0b76d820>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:42.926642 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-f951382d-e17a-4323-b1aa-aef7e9da40cf tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db" status: 202 len: 0 microversion: 2.1 time: 0.064229 Aug 30 02:08:42.927374 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 727/1483] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 30 02:08:42 2022] DELETE /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:08:42.935171 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-52929f20-8784-4242-a192-f7dbcd1e18f1 tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] Calling method '.version_select at 0x7f3b0b89bdc0>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:42.994228 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-52929f20-8784-4242-a192-f7dbcd1e18f1 tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db" status: 200 len: 353 microversion: 2.1 time: 0.062801 Aug 30 02:08:42.994878 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 757/1484] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:42 2022] GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:44.008880 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9d96d40a-3893-4b88-8ee0-352d91eb782a tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] Calling method '.version_select at 0x7f3b0b83ed30>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:44.037033 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-9d96d40a-3893-4b88-8ee0-352d91eb782a tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] HTTP exception thrown: Volume 033d8941-7034-4b17-83f5-22ea619f48db could not be found. Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9d96d40a-3893-4b88-8ee0-352d91eb782a tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] Request method failure captured: Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db HTTP/1.1 Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDXEox3-FHOAVMfVk1oGnvVbsYazfQT7XsObjf7vzGvWF7kVi_ajm0g1XeIQg8XU7YcjyXnHD2g8xEcvBAVW91pkLQ3NzjH4XmoJMRW931WaHzQJ_JFFyHxWFA2gxVdlTqP1Bu3kiast_iVDtQQw4MpRYJYjhruD6_kdy6RKwE-g5hF8 Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 0ef67d6c6e08422893f0174953f24e0d Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-VolumesGetTestJSON-1358985032 Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:08:44.038951 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef67d6c6e08422893f0174953f24e0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef67d6c6e08422893f0174953f24e0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ef67d6c6e08422893f0174953f24e0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ef67d6c6e08422893f0174953f24e0d"}]}] Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-VolumesGetTestJSON-1358985032 Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 0ef67d6c6e08422893f0174953f24e0d Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-VolumesGetTestJSON-1358985032 Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-VolumesGetTestJSON-1358985032-project Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: a70c32d0b5c847c4b34a1cbb494db37e Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-VolumesGetTestJSON-1358985032-project Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Volume 033d8941-7034-4b17-83f5-22ea619f48db could not be found. Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '033d8941-7034-4b17-83f5-22ea619f48db'} Aug 30 02:08:44.040730 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 033d8941-7034-4b17-83f5-22ea619f48db could not be found. (HTTP 404) (Request-ID: req-1230ca1b-702d-4bf5-8b66-3674e25e4312) Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:44.041916 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:08:44.043430 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 033d8941-7034-4b17-83f5-22ea619f48db could not be found. Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 02:08:44.044938 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 033d8941-7034-4b17-83f5-22ea619f48db could not be found. Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 033d8941-7034-4b17-83f5-22ea619f48db could not be found. Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-9d96d40a-3893-4b88-8ee0-352d91eb782a tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] Returning 404 to user: Volume 033d8941-7034-4b17-83f5-22ea619f48db could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-9d96d40a-3893-4b88-8ee0-352d91eb782a tempest-VolumesGetTestJSON-1358985032 tempest-VolumesGetTestJSON-1358985032-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db" status: 404 len: 109 microversion: 2.1 time: 0.036465 Aug 30 02:08:44.046397 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 728/1485] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:44 2022] GET /compute/v2.1/os-volumes/033d8941-7034-4b17-83f5-22ea619f48db => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:10:55.584384 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4a2e377c-b37e-4baa-908f-3cbe3d69e09f] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 02:10:55.585053 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:55.585774 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36906b82-6c60-472a-a548-3bbb0a54bb9c] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 02:10:55.586790 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG dbcounter [-] [120392] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=120392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:55.587165 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_api:SELECT=19 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:55.588166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG dbcounter [-] [120391] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:55.589214 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 02:10:55.589433 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Tue Aug 30 02:10:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 (ip 10.222.0.50) !!! Aug 30 02:10:55.592684 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 02:10:55.592822 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Tue Aug 30 02:10:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 30 02:10:55.595467 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 02:10:55.595616 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Tue Aug 30 02:10:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 30 02:10:55.604050 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-a4a25827-22a3-46af-bdfe-682d0d8f9b8c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:55.604577 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a4a25827-22a3-46af-bdfe-682d0d8f9b8c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:55.612364 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-db7e3fa8-e2b2-4f77-a150-be18eb347081 req-323bdeef-2d4a-4675-9fae-f7a2f44ed836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abbdd816-5a15-4bae-8a89-db3311a05834", "tag": "fa395eb0-fc02-438c-bfe1-12e3122b63fb"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:10:55.620317 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4a25827-22a3-46af-bdfe-682d0d8f9b8c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:55.620809 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4a25827-22a3-46af-bdfe-682d0d8f9b8c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:55.621237 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4a25827-22a3-46af-bdfe-682d0d8f9b8c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:55.622632 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4a25827-22a3-46af-bdfe-682d0d8f9b8c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:55.623087 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4a25827-22a3-46af-bdfe-682d0d8f9b8c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:55.623509 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-a4a25827-22a3-46af-bdfe-682d0d8f9b8c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:55.630897 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-db7e3fa8-e2b2-4f77-a150-be18eb347081 req-323bdeef-2d4a-4675-9fae-f7a2f44ed836 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:55.631386 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-db7e3fa8-e2b2-4f77-a150-be18eb347081 req-323bdeef-2d4a-4675-9fae-f7a2f44ed836 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:55.631815 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-db7e3fa8-e2b2-4f77-a150-be18eb347081 req-323bdeef-2d4a-4675-9fae-f7a2f44ed836 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:55.646944 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-db7e3fa8-e2b2-4f77-a150-be18eb347081 req-323bdeef-2d4a-4675-9fae-f7a2f44ed836 service nova] Creating event network-changed:fa395eb0-fc02-438c-bfe1-12e3122b63fb for instance abbdd816-5a15-4bae-8a89-db3311a05834 on hv-cinder-81966 Aug 30 02:10:55.650771 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-a4a25827-22a3-46af-bdfe-682d0d8f9b8c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Going to try to terminate instance {{(pid=120391) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:10:55.652095 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-db7e3fa8-e2b2-4f77-a150-be18eb347081 req-323bdeef-2d4a-4675-9fae-f7a2f44ed836 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069153 Aug 30 02:10:55.653078 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 729/1486] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:10:55.733561 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-a4a25827-22a3-46af-bdfe-682d0d8f9b8c tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "DELETE /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 204 len: 0 microversion: 2.1 time: 0.153360 Aug 30 02:10:55.734530 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 758/1487] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:10:55 2022] DELETE /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:10:55.744131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-3c32a90b-3ebd-4e3e-86b5-013f8f5bb1c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:55.744889 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-3c32a90b-3ebd-4e3e-86b5-013f8f5bb1c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:55.751896 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c32a90b-3ebd-4e3e-86b5-013f8f5bb1c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:55.752698 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c32a90b-3ebd-4e3e-86b5-013f8f5bb1c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:55.753131 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c32a90b-3ebd-4e3e-86b5-013f8f5bb1c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:55.754105 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c32a90b-3ebd-4e3e-86b5-013f8f5bb1c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:55.754626 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c32a90b-3ebd-4e3e-86b5-013f8f5bb1c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:55.755486 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-3c32a90b-3ebd-4e3e-86b5-013f8f5bb1c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:56.054421 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-3c32a90b-3ebd-4e3e-86b5-013f8f5bb1c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:56.062234 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-3c32a90b-3ebd-4e3e-86b5-013f8f5bb1c4 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1577 microversion: 2.1 time: 0.322660 Aug 30 02:10:56.062886 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 730/1488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:55 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1577 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:57.083423 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-d654001e-e87f-4f97-8e90-44b42c9e6155 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:57.084122 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-d654001e-e87f-4f97-8e90-44b42c9e6155 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:57.092020 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d654001e-e87f-4f97-8e90-44b42c9e6155 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:57.092470 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d654001e-e87f-4f97-8e90-44b42c9e6155 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:57.092911 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d654001e-e87f-4f97-8e90-44b42c9e6155 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:57.093609 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d654001e-e87f-4f97-8e90-44b42c9e6155 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:57.094098 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d654001e-e87f-4f97-8e90-44b42c9e6155 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:57.094531 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-d654001e-e87f-4f97-8e90-44b42c9e6155 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:57.100566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO oslo.messaging._drivers.impl_rabbit [-] [36906b82-6c60-472a-a548-3bbb0a54bb9c] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58674. Aug 30 02:10:57.339051 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-d654001e-e87f-4f97-8e90-44b42c9e6155 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:57.347415 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-d654001e-e87f-4f97-8e90-44b42c9e6155 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1577 microversion: 2.1 time: 0.268140 Aug 30 02:10:57.348166 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 759/1489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:57 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1577 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:58.366268 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-21e593e5-83a4-4c33-af90-f8317509b2b2 req-8208a318-668a-473a-b3f2-a639dd3b08d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbdd816-5a15-4bae-8a89-db3311a05834", "name": "network-vif-deleted", "tag": "fa395eb0-fc02-438c-bfe1-12e3122b63fb"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:10:58.367973 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-21828f1e-ab40-4d64-88f3-7331ccb9d382 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:58.368732 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-21828f1e-ab40-4d64-88f3-7331ccb9d382 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:58.377707 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21828f1e-ab40-4d64-88f3-7331ccb9d382 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:58.379968 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-21e593e5-83a4-4c33-af90-f8317509b2b2 req-8208a318-668a-473a-b3f2-a639dd3b08d7 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:58.380141 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21828f1e-ab40-4d64-88f3-7331ccb9d382 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:58.380487 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-21e593e5-83a4-4c33-af90-f8317509b2b2 req-8208a318-668a-473a-b3f2-a639dd3b08d7 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:58.380914 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-21e593e5-83a4-4c33-af90-f8317509b2b2 req-8208a318-668a-473a-b3f2-a639dd3b08d7 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:58.381202 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21828f1e-ab40-4d64-88f3-7331ccb9d382 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:58.381926 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21828f1e-ab40-4d64-88f3-7331ccb9d382 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:58.382597 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21828f1e-ab40-4d64-88f3-7331ccb9d382 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:58.383032 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-21828f1e-ab40-4d64-88f3-7331ccb9d382 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:58.396102 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-21e593e5-83a4-4c33-af90-f8317509b2b2 req-8208a318-668a-473a-b3f2-a639dd3b08d7 service nova] Creating event network-vif-deleted:fa395eb0-fc02-438c-bfe1-12e3122b63fb for instance abbdd816-5a15-4bae-8a89-db3311a05834 on hv-cinder-81966 Aug 30 02:10:58.399591 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO oslo.messaging._drivers.impl_rabbit [-] [4a2e377c-b37e-4baa-908f-3cbe3d69e09f] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58682. Aug 30 02:10:58.401222 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-21e593e5-83a4-4c33-af90-f8317509b2b2 req-8208a318-668a-473a-b3f2-a639dd3b08d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038917 Aug 30 02:10:58.401809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 731/1490] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:10:58.452588 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-21828f1e-ab40-4d64-88f3-7331ccb9d382 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:58.461307 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-21828f1e-ab40-4d64-88f3-7331ccb9d382 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 200 len: 1393 microversion: 2.1 time: 0.097442 Aug 30 02:10:58.461860 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 760/1491] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:58 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 1393 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:10:59.483356 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:59.484092 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: abbdd816-5a15-4bae-8a89-db3311a05834] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:59.490522 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:59.491043 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:59.491482 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:59.492181 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:59.492668 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:59.493101 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:59.506234 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] HTTP exception thrown: Instance abbdd816-5a15-4bae-8a89-db3311a05834 could not be found. Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Request method failure captured: Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 HTTP/1.1 Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW9dawDWRtJtjMU6KdKbEmXAPBhhIMtn9a6gB8cVwwKvIIxXiA1Jsta1EeLQVPhUGxnF1JDV5cJpuQ4ss1hVjVs5hAIIr5zaGnf5LX-x4hh6WcwjWTsdBBZuZjDtI4E_iime9UcVqhQGI4hMHimzEqHuMNi_-FO6Q5G4XMxj7mLcivo Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 74610e8b7b4d4fafa0e49ba73b94aa48 Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-TestVolumeBootPattern-220186124 Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:10:59.507847 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74610e8b7b4d4fafa0e49ba73b94aa48"}]}] Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-TestVolumeBootPattern-220186124 Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 74610e8b7b4d4fafa0e49ba73b94aa48 Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-TestVolumeBootPattern-220186124 Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-TestVolumeBootPattern-220186124-project Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: bd08361520db465bb9069326d03d0307 Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-TestVolumeBootPattern-220186124-project Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance abbdd816-5a15-4bae-8a89-db3311a05834 could not be found. Aug 30 02:10:59.509662 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': 'abbdd816-5a15-4bae-8a89-db3311a05834'} Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abbdd816-5a15-4bae-8a89-db3311a05834 could not be found. Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:10:59.510845 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abbdd816-5a15-4bae-8a89-db3311a05834 could not be found. Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abbdd816-5a15-4bae-8a89-db3311a05834 could not be found. Aug 30 02:10:59.513399 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:10:59.515136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Returning 404 to user: Instance abbdd816-5a15-4bae-8a89-db3311a05834 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:10:59.515136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-07320b83-cd42-4166-a7b9-7898135ac725 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834" status: 404 len: 111 microversion: 2.1 time: 0.030427 Aug 30 02:10:59.515136 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 732/1492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:59 2022] GET /compute/v2.1/servers/abbdd816-5a15-4bae-8a89-db3311a05834 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:11:02.559825 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-095324c7-e40e-4cce-ab89-3885dda58c85 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:02.564961 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-fc4c2c4f-3c62-4cfb-b417-33e098e22aab req-948b6f64-140f-4d6e-bb61-1bd07af30ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d175d1c1-24a5-488c-87b9-6de5c2b20479", "tag": "4b5a253a-9dd3-4c0d-a265-de8c1a9ebbed"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:02.571488 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-095324c7-e40e-4cce-ab89-3885dda58c85 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:02.575615 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-fc4c2c4f-3c62-4cfb-b417-33e098e22aab req-948b6f64-140f-4d6e-bb61-1bd07af30ff0 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:02.576182 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-fc4c2c4f-3c62-4cfb-b417-33e098e22aab req-948b6f64-140f-4d6e-bb61-1bd07af30ff0 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:02.576809 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-fc4c2c4f-3c62-4cfb-b417-33e098e22aab req-948b6f64-140f-4d6e-bb61-1bd07af30ff0 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:02.579024 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-095324c7-e40e-4cce-ab89-3885dda58c85 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:02.579571 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-095324c7-e40e-4cce-ab89-3885dda58c85 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:02.580066 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-095324c7-e40e-4cce-ab89-3885dda58c85 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:02.580868 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-095324c7-e40e-4cce-ab89-3885dda58c85 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:02.581532 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-095324c7-e40e-4cce-ab89-3885dda58c85 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:02.582125 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-095324c7-e40e-4cce-ab89-3885dda58c85 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:02.589327 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-fc4c2c4f-3c62-4cfb-b417-33e098e22aab req-948b6f64-140f-4d6e-bb61-1bd07af30ff0 service nova] Creating event network-changed:4b5a253a-9dd3-4c0d-a265-de8c1a9ebbed for instance d175d1c1-24a5-488c-87b9-6de5c2b20479 on hv-cinder-81966 Aug 30 02:11:02.595052 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-fc4c2c4f-3c62-4cfb-b417-33e098e22aab req-948b6f64-140f-4d6e-bb61-1bd07af30ff0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033582 Aug 30 02:11:02.596106 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 733/1493] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:11:02.609691 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-095324c7-e40e-4cce-ab89-3885dda58c85 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Going to try to terminate instance {{(pid=120391) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:11:02.692722 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-095324c7-e40e-4cce-ab89-3885dda58c85 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 204 len: 0 microversion: 2.1 time: 0.136270 Aug 30 02:11:02.693918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 761/1494] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:11:02 2022] DELETE /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:11:02.703835 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-93b9b445-8c47-4fac-a939-a16f0203ddd2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:02.705524 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-93b9b445-8c47-4fac-a939-a16f0203ddd2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:02.713490 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93b9b445-8c47-4fac-a939-a16f0203ddd2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:02.714215 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93b9b445-8c47-4fac-a939-a16f0203ddd2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:02.714831 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93b9b445-8c47-4fac-a939-a16f0203ddd2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:02.715895 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93b9b445-8c47-4fac-a939-a16f0203ddd2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:02.716659 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93b9b445-8c47-4fac-a939-a16f0203ddd2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:02.717246 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-93b9b445-8c47-4fac-a939-a16f0203ddd2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:02.852680 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.policy [None req-93b9b445-8c47-4fac-a939-a16f0203ddd2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120392) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:02.860365 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-93b9b445-8c47-4fac-a939-a16f0203ddd2 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1576 microversion: 2.1 time: 0.161719 Aug 30 02:11:02.860934 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 734/1495] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:02 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:03.882611 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3749cee7-67bd-45c0-8b2f-e2d995b55c93 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:03.883335 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-3749cee7-67bd-45c0-8b2f-e2d995b55c93 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:03.890679 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3749cee7-67bd-45c0-8b2f-e2d995b55c93 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:03.891163 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3749cee7-67bd-45c0-8b2f-e2d995b55c93 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:03.891964 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3749cee7-67bd-45c0-8b2f-e2d995b55c93 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:03.892324 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3749cee7-67bd-45c0-8b2f-e2d995b55c93 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:03.892775 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3749cee7-67bd-45c0-8b2f-e2d995b55c93 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:03.893263 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3749cee7-67bd-45c0-8b2f-e2d995b55c93 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:03.995495 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.policy [None req-3749cee7-67bd-45c0-8b2f-e2d995b55c93 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd08361520db465bb9069326d03d0307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74610e8b7b4d4fafa0e49ba73b94aa48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120391) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:04.003553 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3749cee7-67bd-45c0-8b2f-e2d995b55c93 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 200 len: 1391 microversion: 2.1 time: 0.125036 Aug 30 02:11:04.004056 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 762/1496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:03 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 1391 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:04.609345 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [req-fb6b43b6-a4bf-4fa4-b922-fbcb497c24d8 req-2edbc354-8037-46ba-9a1b-0fb31d97bf16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d175d1c1-24a5-488c-87b9-6de5c2b20479", "name": "network-vif-deleted", "tag": "4b5a253a-9dd3-4c0d-a265-de8c1a9ebbed"}]} {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:04.619256 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-fb6b43b6-a4bf-4fa4-b922-fbcb497c24d8 req-2edbc354-8037-46ba-9a1b-0fb31d97bf16 service nova] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:04.619727 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-fb6b43b6-a4bf-4fa4-b922-fbcb497c24d8 req-2edbc354-8037-46ba-9a1b-0fb31d97bf16 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:04.620155 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [req-fb6b43b6-a4bf-4fa4-b922-fbcb497c24d8 req-2edbc354-8037-46ba-9a1b-0fb31d97bf16 service nova] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:04.630801 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.compute.server_external_events [req-fb6b43b6-a4bf-4fa4-b922-fbcb497c24d8 req-2edbc354-8037-46ba-9a1b-0fb31d97bf16 service nova] Creating event network-vif-deleted:4b5a253a-9dd3-4c0d-a265-de8c1a9ebbed for instance d175d1c1-24a5-488c-87b9-6de5c2b20479 on hv-cinder-81966 Aug 30 02:11:04.635389 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [req-fb6b43b6-a4bf-4fa4-b922-fbcb497c24d8 req-2edbc354-8037-46ba-9a1b-0fb31d97bf16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029719 Aug 30 02:11:04.635955 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 735/1497] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 30 02:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:11:05.025282 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:05.025889 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: d175d1c1-24a5-488c-87b9-6de5c2b20479] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:05.032664 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:05.033139 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:05.033566 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:05.034243 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:05.034688 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:05.035105 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:05.048597 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] HTTP exception thrown: Instance d175d1c1-24a5-488c-87b9-6de5c2b20479 could not be found. Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Request method failure captured: Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 HTTP/1.1 Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW9dawDWRtJtjMU6KdKbEmXAPBhhIMtn9a6gB8cVwwKvIIxXiA1Jsta1EeLQVPhUGxnF1JDV5cJpuQ4ss1hVjVs5hAIIr5zaGnf5LX-x4hh6WcwjWTsdBBZuZjDtI4E_iime9UcVqhQGI4hMHimzEqHuMNi_-FO6Q5G4XMxj7mLcivo Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 74610e8b7b4d4fafa0e49ba73b94aa48 Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-TestVolumeBootPattern-220186124 Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:11:05.050193 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74610e8b7b4d4fafa0e49ba73b94aa48"}]}] Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-TestVolumeBootPattern-220186124 Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 74610e8b7b4d4fafa0e49ba73b94aa48 Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-TestVolumeBootPattern-220186124 Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-TestVolumeBootPattern-220186124-project Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: bd08361520db465bb9069326d03d0307 Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-TestVolumeBootPattern-220186124-project Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance d175d1c1-24a5-488c-87b9-6de5c2b20479 could not be found. Aug 30 02:11:05.051990 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': 'd175d1c1-24a5-488c-87b9-6de5c2b20479'} Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d175d1c1-24a5-488c-87b9-6de5c2b20479 could not be found. Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:11:05.053131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d175d1c1-24a5-488c-87b9-6de5c2b20479 could not be found. Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d175d1c1-24a5-488c-87b9-6de5c2b20479 could not be found. Aug 30 02:11:05.054747 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.056179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Returning 404 to user: Instance d175d1c1-24a5-488c-87b9-6de5c2b20479 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:11:05.056179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c1b74d20-cd5d-48c1-a9a4-9d26119052c1 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479" status: 404 len: 111 microversion: 2.1 time: 0.030085 Aug 30 02:11:05.056179 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 763/1498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:05 2022] GET /compute/v2.1/servers/d175d1c1-24a5-488c-87b9-6de5c2b20479 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:11:05.487200 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:05.487771 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.compute.api [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120392) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:05.493980 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:05.494455 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:05.494884 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:05.495560 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:05.496007 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:05.496454 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG oslo_concurrency.lockutils [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:05.509254 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.wsgi [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] HTTP exception thrown: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Request method failure captured: Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: request: DELETE /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 HTTP/1.1 Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept: application/json Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Accept-Encoding: identity Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Connection: close Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Length: 0 Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Content-Type: application/json Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Host: 10.222.0.50 Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: Openstack-System-Scope: None Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: User-Agent: python-urllib3/1.26.12 Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Auth-Token: gAAAAABjDW9dawDWRtJtjMU6KdKbEmXAPBhhIMtn9a6gB8cVwwKvIIxXiA1Jsta1EeLQVPhUGxnF1JDV5cJpuQ4ss1hVjVs5hAIIr5zaGnf5LX-x4hh6WcwjWTsdBBZuZjDtI4E_iime9UcVqhQGI4hMHimzEqHuMNi_-FO6Q5G4XMxj7mLcivo Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Id: None Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Domain-Name: None Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Identity-Status: Confirmed Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Is-Admin-Project: True Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Id: default Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Domain-Name: Default Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Id: 74610e8b7b4d4fafa0e49ba73b94aa48 Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Project-Name: tempest-TestVolumeBootPattern-220186124 Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Role: member,reader Aug 30 02:11:05.510875 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Roles: member,reader Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74610e8b7b4d4fafa0e49ba73b94aa48"}]}] Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant: tempest-TestVolumeBootPattern-220186124 Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Id: 74610e8b7b4d4fafa0e49ba73b94aa48 Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-Tenant-Name: tempest-TestVolumeBootPattern-220186124 Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User: tempest-TestVolumeBootPattern-220186124-project Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Id: default Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Domain-Name: Default Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Id: bd08361520db465bb9069326d03d0307 Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: X-User-Name: tempest-TestVolumeBootPattern-220186124-project Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: method: > Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: exception: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:11:05.513371 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: action_args: {'id': '8e06f030-1187-44b2-bf6d-dfff52fbbc06'} Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:11:05.514236 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:11:05.515594 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.517028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Returning 404 to user: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. {{(pid=120392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:11:05.517028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-43f1fbb2-27df-4204-b64d-45094c6edf09 tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 404 len: 111 microversion: 2.1 time: 0.030392 Aug 30 02:11:05.517028 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 736/1499] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 30 02:11:05 2022] DELETE /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:11:05.521341 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:05.521953 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.compute.api [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] [instance: 8e06f030-1187-44b2-bf6d-dfff52fbbc06] Fetching instance by UUID {{(pid=120391) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:05.528444 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:05.528918 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:05.529347 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:05.530022 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Acquiring lock "99d86a54-00a5-438e-9f83-1aa5b257911d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:05.530464 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:05.530881 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Lock "99d86a54-00a5-438e-9f83-1aa5b257911d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:05.543931 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] HTTP exception thrown: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Request method failure captured: Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: request: GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 HTTP/1.1 Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept: application/json Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Accept-Encoding: identity Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Connection: close Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Length: 0 Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Content-Type: application/json Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Host: 10.222.0.50 Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: Openstack-System-Scope: None Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: User-Agent: python-urllib3/1.26.12 Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Auth-Token: gAAAAABjDW9dawDWRtJtjMU6KdKbEmXAPBhhIMtn9a6gB8cVwwKvIIxXiA1Jsta1EeLQVPhUGxnF1JDV5cJpuQ4ss1hVjVs5hAIIr5zaGnf5LX-x4hh6WcwjWTsdBBZuZjDtI4E_iime9UcVqhQGI4hMHimzEqHuMNi_-FO6Q5G4XMxj7mLcivo Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Id: None Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Domain-Name: None Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Identity-Status: Confirmed Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Is-Admin-Project: True Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Id: default Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Domain-Name: Default Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Id: 74610e8b7b4d4fafa0e49ba73b94aa48 Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Project-Name: tempest-TestVolumeBootPattern-220186124 Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Role: member,reader Aug 30 02:11:05.545442 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Roles: member,reader Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74610e8b7b4d4fafa0e49ba73b94aa48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74610e8b7b4d4fafa0e49ba73b94aa48"}]}] Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant: tempest-TestVolumeBootPattern-220186124 Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Id: 74610e8b7b4d4fafa0e49ba73b94aa48 Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-Tenant-Name: tempest-TestVolumeBootPattern-220186124 Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User: tempest-TestVolumeBootPattern-220186124-project Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Id: default Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Domain-Name: Default Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Id: bd08361520db465bb9069326d03d0307 Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: X-User-Name: tempest-TestVolumeBootPattern-220186124-project Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: method: > Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: exception: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:11:05.547121 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: action_args: {'id': '8e06f030-1187-44b2-bf6d-dfff52fbbc06'} Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:11:05.548131 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. Aug 30 02:11:05.549782 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: ERROR nova.api.openstack.wsgi Aug 30 02:11:05.551568 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Returning 404 to user: Instance 8e06f030-1187-44b2-bf6d-dfff52fbbc06 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:11:05.551568 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-fa3009ff-9259-464f-810e-da8d665a102b tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06" status: 404 len: 111 microversion: 2.1 time: 0.029203 Aug 30 02:11:05.551568 dv-cinder-819668-6-iscsi devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 764/1500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:05 2022] GET /compute/v2.1/servers/8e06f030-1187-44b2-bf6d-dfff52fbbc06 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:11:06.837316 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: DEBUG nova.api.openstack.wsgi [None req-90b44846-c437-457e-a75d-c446d70552ee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] Calling method '.version_select at 0x7f3b0b83ee50>' {{(pid=120392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:06.873228 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: INFO nova.api.openstack.requestlog [None req-90b44846-c437-457e-a75d-c446d70552ee tempest-TestVolumeBootPattern-220186124 tempest-TestVolumeBootPattern-220186124-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2051291069" status: 202 len: 0 microversion: 2.1 time: 0.039693 Aug 30 02:11:06.877484 dv-cinder-819668-6-iscsi devstack@n-api.service[120392]: [pid: 120392|app: 0|req: 737/1501] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 30 02:11:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2051291069 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)